[==========] Running 14 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 14 tests from AutoRebalancerTest
[ RUN ] AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251211 21:02:33.808372 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:38767,127.29.190.253:34837,127.29.190.252:37267
I20251211 21:02:33.809507 30459 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 21:02:33.810060 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:33.816988 30464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:33.816989 30465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:33.816988 30467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:33.817183 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:33.817838 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:33.817948 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:33.817981 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486953817979 us; error 0 us; skew 500 ppm
I20251211 21:02:33.819844 30459 webserver.cc:492] Webserver started at http://127.29.190.254:36483/ using document root <none> and password file <none>
I20251211 21:02:33.820403 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:33.820461 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:33.820672 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:33.822337 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "7cb0082e2e84466d986261e576007058"
format_stamp: "Formatted at 2025-12-11 21:02:33 on dist-test-slave-xjj2"
I20251211 21:02:33.825911 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251211 21:02:33.828099 30472 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:33.829171 30459 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251211 21:02:33.829267 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "7cb0082e2e84466d986261e576007058"
format_stamp: "Formatted at 2025-12-11 21:02:33 on dist-test-slave-xjj2"
I20251211 21:02:33.829345 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:33.856931 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:33.857610 30459 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 21:02:33.857754 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:33.865108 30524 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:38767 every 8 connection(s)
I20251211 21:02:33.865123 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:38767
I20251211 21:02:33.866441 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:33.868157 30528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:33.868304 30527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:33.868322 30530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:33.868552 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:33.868700 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:33.868743 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:33.868762 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486953868761 us; error 0 us; skew 500 ppm
I20251211 21:02:33.869249 30525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:33.869642 30459 webserver.cc:492] Webserver started at http://127.29.190.253:38705/ using document root <none> and password file <none>
I20251211 21:02:33.869778 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:33.869827 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:33.869892 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:33.870326 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root/instance:
uuid: "a704668e14604bd5bdf2852f9f2e4d5d"
format_stamp: "Formatted at 2025-12-11 21:02:33 on dist-test-slave-xjj2"
I20251211 21:02:33.871971 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:02:33.872965 30535 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:33.873221 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:33.873278 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root
uuid: "a704668e14604bd5bdf2852f9f2e4d5d"
format_stamp: "Formatted at 2025-12-11 21:02:33 on dist-test-slave-xjj2"
I20251211 21:02:33.873337 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:33.874115 30525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:33.887182 30525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } has no permanent_uuid. Determining permanent_uuid...
W20251211 21:02:33.887909 30474 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.253:34837: connect: Connection refused (error 111)
W20251211 21:02:33.888686 30525 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.190.253:34837: Network error: Client connection negotiation failed: client connection to 127.29.190.253:34837: connect: Connection refused (error 111)
I20251211 21:02:33.904907 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:33.905365 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:33.910123 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.253:34837
I20251211 21:02:33.910177 30590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.253:34837 every 8 connection(s)
I20251211 21:02:33.910802 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:02:33.911001 30591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20251211 21:02:33.912418 30593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:33.912524 30591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } has no permanent_uuid. Determining permanent_uuid...
W20251211 21:02:33.912647 30596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:33.912678 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:33.912431 30594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:33.913002 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:33.913046 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:33.913066 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486953913065 us; error 0 us; skew 500 ppm
I20251211 21:02:33.913916 30459 webserver.cc:492] Webserver started at http://127.29.190.252:36547/ using document root <none> and password file <none>
I20251211 21:02:33.914057 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:33.914108 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:33.914191 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:33.914503 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root/instance:
uuid: "f2d5ebd1eca949e9afcce28b507b13cf"
format_stamp: "Formatted at 2025-12-11 21:02:33 on dist-test-slave-xjj2"
I20251211 21:02:33.916246 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20251211 21:02:33.916860 30591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:33.917248 30602 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:33.917760 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:33.917833 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root
uuid: "f2d5ebd1eca949e9afcce28b507b13cf"
format_stamp: "Formatted at 2025-12-11 21:02:33 on dist-test-slave-xjj2"
I20251211 21:02:33.917892 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:33.920899 30591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } has no permanent_uuid. Determining permanent_uuid...
W20251211 21:02:33.922127 30591 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.190.252:37267: Network error: Client connection negotiation failed: client connection to 127.29.190.252:37267: connect: Connection refused (error 111)
I20251211 21:02:33.934475 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:33.934895 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:33.937904 30525 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } attempt: 1
I20251211 21:02:33.940150 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.252:37267
I20251211 21:02:33.940186 30656 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.252:37267 every 8 connection(s)
I20251211 21:02:33.940610 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:02:33.941118 30657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:33.942209 30525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:33.942277 30657 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:33.946426 30657 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:33.948621 30525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: Bootstrap starting.
I20251211 21:02:33.950047 30657 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:33.951297 30525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:33.952136 30525 log.cc:826] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: Log is configured to *not* fsync() on all Append() calls
I20251211 21:02:33.953715 30525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: No bootstrap required, opened a new log
I20251211 21:02:33.956244 30525 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.956401 30525 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:33.956454 30525 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cb0082e2e84466d986261e576007058, State: Initialized, Role: FOLLOWER
I20251211 21:02:33.956821 30525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.957139 30657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf: Bootstrap starting.
I20251211 21:02:33.957242 30662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:33.957376 30662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:33.957876 30525 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:02:33.958079 30657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:33.959318 30657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf: No bootstrap required, opened a new log
I20251211 21:02:33.959798 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20251211 21:02:33.959786 30657 raft_consensus.cc:359] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.959887 30657 raft_consensus.cc:385] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:33.959924 30657 raft_consensus.cc:740] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d5ebd1eca949e9afcce28b507b13cf, State: Initialized, Role: FOLLOWER
I20251211 21:02:33.960037 30657 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.960306 30675 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:33.960399 30675 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:33.960422 30657 sys_catalog.cc:565] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: configured and running, proceeding with master startup.
W20251211 21:02:33.962710 30687 catalog_manager.cc:1568] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 21:02:33.962710 30674 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 21:02:33.962791 30687 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20251211 21:02:33.962826 30674 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 21:02:33.974242 30591 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } attempt: 1
I20251211 21:02:33.979566 30591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d: Bootstrap starting.
I20251211 21:02:33.980546 30591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:33.981884 30591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d: No bootstrap required, opened a new log
I20251211 21:02:33.982285 30591 raft_consensus.cc:359] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.982406 30591 raft_consensus.cc:385] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:33.982440 30591 raft_consensus.cc:740] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a704668e14604bd5bdf2852f9f2e4d5d, State: Initialized, Role: FOLLOWER
I20251211 21:02:33.982565 30591 consensus_queue.cc:260] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.982882 30689 sys_catalog.cc:455] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:33.982990 30689 sys_catalog.cc:458] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:33.983055 30591 sys_catalog.cc:565] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:02:33.984647 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20251211 21:02:33.985206 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:33.985302 30700 catalog_manager.cc:1568] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 21:02:33.985387 30700 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20251211 21:02:33.987375 30701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:33.987479 30704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:33.987540 30702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:33.987731 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:33.987890 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:33.987936 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:33.987967 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486953987965 us; error 0 us; skew 500 ppm
I20251211 21:02:33.988276 30675 raft_consensus.cc:493] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:33.988416 30675 raft_consensus.cc:515] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.988914 30459 webserver.cc:492] Webserver started at http://127.29.190.193:40603/ using document root <none> and password file <none>
I20251211 21:02:33.989064 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:33.989116 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:33.989187 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:33.989343 30675 leader_election.cc:290] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cb0082e2e84466d986261e576007058 (127.29.190.254:38767), a704668e14604bd5bdf2852f9f2e4d5d (127.29.190.253:34837)
I20251211 21:02:33.989617 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "1ee535d959434d6b946dd4cd41edba1a"
format_stamp: "Formatted at 2025-12-11 21:02:33 on dist-test-slave-xjj2"
I20251211 21:02:33.989816 30499 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cb0082e2e84466d986261e576007058" is_pre_election: true
I20251211 21:02:33.989816 30565 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" is_pre_election: true
I20251211 21:02:33.990031 30565 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2d5ebd1eca949e9afcce28b507b13cf in term 0.
I20251211 21:02:33.990031 30499 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2d5ebd1eca949e9afcce28b507b13cf in term 0.
I20251211 21:02:33.990430 30605 leader_election.cc:304] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a704668e14604bd5bdf2852f9f2e4d5d, f2d5ebd1eca949e9afcce28b507b13cf; no voters:
I20251211 21:02:33.990644 30675 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:33.990698 30675 raft_consensus.cc:493] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:33.990734 30675 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:33.991323 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:33.991639 30675 raft_consensus.cc:515] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.991986 30675 leader_election.cc:290] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [CANDIDATE]: Term 1 election: Requested vote from peers 7cb0082e2e84466d986261e576007058 (127.29.190.254:38767), a704668e14604bd5bdf2852f9f2e4d5d (127.29.190.253:34837)
I20251211 21:02:33.992368 30565 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a704668e14604bd5bdf2852f9f2e4d5d"
I20251211 21:02:33.992416 30499 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cb0082e2e84466d986261e576007058"
I20251211 21:02:33.992476 30565 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:33.992479 30499 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:33.993404 30565 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d5ebd1eca949e9afcce28b507b13cf in term 1.
I20251211 21:02:33.993657 30709 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:33.993721 30499 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d5ebd1eca949e9afcce28b507b13cf in term 1.
I20251211 21:02:33.993732 30605 leader_election.cc:304] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a704668e14604bd5bdf2852f9f2e4d5d, f2d5ebd1eca949e9afcce28b507b13cf; no voters:
I20251211 21:02:33.993935 30459 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20251211 21:02:33.993992 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "1ee535d959434d6b946dd4cd41edba1a"
format_stamp: "Formatted at 2025-12-11 21:02:33 on dist-test-slave-xjj2"
I20251211 21:02:33.994042 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:33.994239 30675 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:33.994427 30675 raft_consensus.cc:697] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 1 LEADER]: Becoming Leader. State: Replica: f2d5ebd1eca949e9afcce28b507b13cf, State: Running, Role: LEADER
I20251211 21:02:33.994707 30675 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } }
I20251211 21:02:33.996752 30710 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2d5ebd1eca949e9afcce28b507b13cf. Latest consensus state: current_term: 1 leader_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:33.996850 30710 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:33.997783 30716 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:02:33.998821 30716 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:02:34.004271 30499 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 1 FOLLOWER]: Refusing update from remote peer f2d5ebd1eca949e9afcce28b507b13cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:02:34.004271 30565 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 1 FOLLOWER]: Refusing update from remote peer f2d5ebd1eca949e9afcce28b507b13cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:02:34.004887 30675 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:34.005024 30710 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:34.007071 30662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2d5ebd1eca949e9afcce28b507b13cf. Latest consensus state: current_term: 1 leader_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:34.007190 30662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:34.007206 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:34.007293 30689 sys_catalog.cc:455] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2d5ebd1eca949e9afcce28b507b13cf. Latest consensus state: current_term: 1 leader_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:34.007401 30689 sys_catalog.cc:458] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:34.007688 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:34.008142 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:34.009068 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:34.009135 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:34.009234 30710 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:34.009332 30710 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:34.009231 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:34.009475 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:34.009439 30675 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:34.009661 30675 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:34.010299 30719 mvcc.cc:204] Tried to move back new op lower bound from 7231434563594711040 to 7231434563565912064. Current Snapshot: MvccSnapshot[applied={T|T < 7231434563594711040}]
I20251211 21:02:34.010565 30689 sys_catalog.cc:455] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:34.010646 30689 sys_catalog.cc:458] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:34.010280 30662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cb0082e2e84466d986261e576007058" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 38767 } } peers { permanent_uuid: "a704668e14604bd5bdf2852f9f2e4d5d" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 34837 } } peers { permanent_uuid: "f2d5ebd1eca949e9afcce28b507b13cf" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 37267 } } }
I20251211 21:02:34.010861 30662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:34.012739 30716 catalog_manager.cc:1357] Generated new cluster ID: 6ae274b793164f94a500db31b94ca290
I20251211 21:02:34.012801 30716 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:02:34.016187 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:45473
I20251211 21:02:34.016214 30784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:45473 every 8 connection(s)
I20251211 21:02:34.017303 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:34.019522 30790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:34.020226 30791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:34.023654 30785 heartbeater.cc:344] Connected to a master server at 127.29.190.252:37267
I20251211 21:02:34.023804 30785 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.024437 30785 heartbeater.cc:507] Master 127.29.190.252:37267 requested a full tablet report, sending...
I20251211 21:02:34.025871 30621 ts_manager.cc:194] Registered new tserver with Master: 1ee535d959434d6b946dd4cd41edba1a (127.29.190.193:45473)
I20251211 21:02:34.026875 30787 heartbeater.cc:344] Connected to a master server at 127.29.190.253:34837
I20251211 21:02:34.026952 30787 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.027166 30787 heartbeater.cc:507] Master 127.29.190.253:34837 requested a full tablet report, sending...
I20251211 21:02:34.027357 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:34.027645 30793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:34.027786 30786 heartbeater.cc:344] Connected to a master server at 127.29.190.254:38767
I20251211 21:02:34.027873 30786 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.027910 30555 ts_manager.cc:194] Registered new tserver with Master: 1ee535d959434d6b946dd4cd41edba1a (127.29.190.193:45473)
I20251211 21:02:34.027946 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:34.027979 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:34.027998 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486954027997 us; error 0 us; skew 500 ppm
I20251211 21:02:34.028057 30786 heartbeater.cc:507] Master 127.29.190.254:38767 requested a full tablet report, sending...
I20251211 21:02:34.028927 30459 webserver.cc:492] Webserver started at http://127.29.190.194:40843/ using document root <none> and password file <none>
I20251211 21:02:34.028963 30488 ts_manager.cc:194] Registered new tserver with Master: 1ee535d959434d6b946dd4cd41edba1a (127.29.190.193:45473)
I20251211 21:02:34.029129 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:34.029175 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:34.029230 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:34.029610 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "f2526700d3464444b6351a3f782088e4"
format_stamp: "Formatted at 2025-12-11 21:02:34 on dist-test-slave-xjj2"
I20251211 21:02:34.031178 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:02:34.032182 30800 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:34.032449 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251211 21:02:34.032511 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "f2526700d3464444b6351a3f782088e4"
format_stamp: "Formatted at 2025-12-11 21:02:34 on dist-test-slave-xjj2"
I20251211 21:02:34.032572 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:34.039572 30716 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:02:34.040848 30716 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:02:34.042027 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:34.042394 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:34.042688 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:34.043200 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:34.043239 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:34.043280 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:34.043306 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:34.048666 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:46385
I20251211 21:02:34.048697 30863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:46385 every 8 connection(s)
I20251211 21:02:34.049638 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:34.052768 30869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:34.053144 30870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:34.054334 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:34.054936 30716 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf: Generated new TSK 0
I20251211 21:02:34.055833 30716 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251211 21:02:34.057291 30872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:34.057448 30865 heartbeater.cc:344] Connected to a master server at 127.29.190.254:38767
I20251211 21:02:34.057534 30865 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.057765 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251211 21:02:34.057770 30865 heartbeater.cc:507] Master 127.29.190.254:38767 requested a full tablet report, sending...
W20251211 21:02:34.057873 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:34.057988 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486954057987 us; error 0 us; skew 500 ppm
I20251211 21:02:34.058465 30866 heartbeater.cc:344] Connected to a master server at 127.29.190.253:34837
I20251211 21:02:34.058547 30866 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.058758 30866 heartbeater.cc:507] Master 127.29.190.253:34837 requested a full tablet report, sending...
I20251211 21:02:34.058550 30488 ts_manager.cc:194] Registered new tserver with Master: f2526700d3464444b6351a3f782088e4 (127.29.190.194:46385)
I20251211 21:02:34.059144 30459 webserver.cc:492] Webserver started at http://127.29.190.195:46335/ using document root <none> and password file <none>
I20251211 21:02:34.059288 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:34.059353 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:34.059417 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:34.059914 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "bf8058d82e7142ac9e3dd86d6abc68f4"
format_stamp: "Formatted at 2025-12-11 21:02:34 on dist-test-slave-xjj2"
I20251211 21:02:34.060009 30555 ts_manager.cc:194] Registered new tserver with Master: f2526700d3464444b6351a3f782088e4 (127.29.190.194:46385)
I20251211 21:02:34.061746 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:34.062412 30864 heartbeater.cc:344] Connected to a master server at 127.29.190.252:37267
I20251211 21:02:34.062489 30864 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.062674 30864 heartbeater.cc:507] Master 127.29.190.252:37267 requested a full tablet report, sending...
I20251211 21:02:34.063174 30621 ts_manager.cc:194] Registered new tserver with Master: f2526700d3464444b6351a3f782088e4 (127.29.190.194:46385)
I20251211 21:02:34.063825 30879 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:34.064077 30459 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251211 21:02:34.064139 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "bf8058d82e7142ac9e3dd86d6abc68f4"
format_stamp: "Formatted at 2025-12-11 21:02:34 on dist-test-slave-xjj2"
I20251211 21:02:34.064201 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:34.064599 30621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42860
I20251211 21:02:34.070209 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:34.070583 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:34.070854 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:34.071336 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:34.071375 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:34.071415 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:34.071442 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:34.077029 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:43777
I20251211 21:02:34.077158 30942 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:43777 every 8 connection(s)
I20251211 21:02:34.082839 30943 heartbeater.cc:344] Connected to a master server at 127.29.190.252:37267
I20251211 21:02:34.082938 30943 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.083122 30944 heartbeater.cc:344] Connected to a master server at 127.29.190.254:38767
I20251211 21:02:34.083230 30944 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.083150 30943 heartbeater.cc:507] Master 127.29.190.252:37267 requested a full tablet report, sending...
I20251211 21:02:34.083460 30944 heartbeater.cc:507] Master 127.29.190.254:38767 requested a full tablet report, sending...
I20251211 21:02:34.083124 30945 heartbeater.cc:344] Connected to a master server at 127.29.190.253:34837
I20251211 21:02:34.083555 30945 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:34.083966 30621 ts_manager.cc:194] Registered new tserver with Master: bf8058d82e7142ac9e3dd86d6abc68f4 (127.29.190.195:43777)
I20251211 21:02:34.084069 30488 ts_manager.cc:194] Registered new tserver with Master: bf8058d82e7142ac9e3dd86d6abc68f4 (127.29.190.195:43777)
I20251211 21:02:34.084220 30945 heartbeater.cc:507] Master 127.29.190.253:34837 requested a full tablet report, sending...
I20251211 21:02:34.084594 30621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42870
I20251211 21:02:34.084772 30555 ts_manager.cc:194] Registered new tserver with Master: bf8058d82e7142ac9e3dd86d6abc68f4 (127.29.190.195:43777)
I20251211 21:02:34.084801 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007204258s
I20251211 21:02:34.963953 30674 catalog_manager.cc:1269] Loaded cluster ID: 6ae274b793164f94a500db31b94ca290
I20251211 21:02:34.964036 30674 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: loading cluster ID for follower catalog manager: success
I20251211 21:02:34.965252 30674 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: acquiring CA information for follower catalog manager: success
I20251211 21:02:34.965916 30674 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251211 21:02:34.986114 30700 catalog_manager.cc:1269] Loaded cluster ID: 6ae274b793164f94a500db31b94ca290
I20251211 21:02:34.986202 30700 catalog_manager.cc:1562] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d: loading cluster ID for follower catalog manager: success
I20251211 21:02:34.987295 30700 catalog_manager.cc:1584] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d: acquiring CA information for follower catalog manager: success
I20251211 21:02:34.987841 30700 catalog_manager.cc:1612] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251211 21:02:35.028280 30621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42856
I20251211 21:02:35.065949 30864 heartbeater.cc:499] Master 127.29.190.252:37267 was elected leader, sending a full tablet report...
I20251211 21:02:35.085376 30943 heartbeater.cc:499] Master 127.29.190.252:37267 was elected leader, sending a full tablet report...
I20251211 21:02:35.962327 30686 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:36.029446 30785 heartbeater.cc:499] Master 127.29.190.252:37267 was elected leader, sending a full tablet report...
I20251211 21:02:36.138613 30459 test_util.cc:276] Using random seed: 1994412143
I20251211 21:02:36.151136 30621 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42886:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251211 21:02:36.169346 30828 tablet_service.cc:1505] Processing CreateTablet for tablet eecd31e10a674c4eb24a8ec6d90aa501 (DEFAULT_TABLE table=test-workload [id=0ec679fc371a4141889f719a2b27e442]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:02:36.169534 30748 tablet_service.cc:1505] Processing CreateTablet for tablet fd317f97518049d8a459d588a9763435 (DEFAULT_TABLE table=test-workload [id=0ec679fc371a4141889f719a2b27e442]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:02:36.169879 30748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd317f97518049d8a459d588a9763435. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:36.169879 30828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecd31e10a674c4eb24a8ec6d90aa501. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:36.169346 30749 tablet_service.cc:1505] Processing CreateTablet for tablet 9a56c7e9f85b48d687ec877a50c38c89 (DEFAULT_TABLE table=test-workload [id=0ec679fc371a4141889f719a2b27e442]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:02:36.171954 30749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a56c7e9f85b48d687ec877a50c38c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:36.172626 30979 tablet_bootstrap.cc:492] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a: Bootstrap starting.
I20251211 21:02:36.172847 30980 tablet_bootstrap.cc:492] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4: Bootstrap starting.
I20251211 21:02:36.173862 30980 tablet_bootstrap.cc:654] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:36.173873 30979 tablet_bootstrap.cc:654] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:36.175060 30980 tablet_bootstrap.cc:492] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4: No bootstrap required, opened a new log
I20251211 21:02:36.175177 30980 ts_tablet_manager.cc:1403] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:36.175693 30980 raft_consensus.cc:359] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2526700d3464444b6351a3f782088e4" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46385 } }
I20251211 21:02:36.175788 30980 raft_consensus.cc:385] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:36.175817 30980 raft_consensus.cc:740] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2526700d3464444b6351a3f782088e4, State: Initialized, Role: FOLLOWER
I20251211 21:02:36.175937 30980 consensus_queue.cc:260] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2526700d3464444b6351a3f782088e4" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46385 } }
I20251211 21:02:36.176035 30980 raft_consensus.cc:399] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:36.176005 30907 tablet_service.cc:1505] Processing CreateTablet for tablet cae84f2d627b40d6b68761b294ab08ca (DEFAULT_TABLE table=test-workload [id=0ec679fc371a4141889f719a2b27e442]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:02:36.176079 30980 raft_consensus.cc:493] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:36.176115 30979 tablet_bootstrap.cc:492] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a: No bootstrap required, opened a new log
I20251211 21:02:36.176118 30980 raft_consensus.cc:3060] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:36.176198 30979 ts_tablet_manager.cc:1403] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:02:36.176223 30907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae84f2d627b40d6b68761b294ab08ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:36.176570 30979 raft_consensus.cc:359] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } }
I20251211 21:02:36.176645 30979 raft_consensus.cc:385] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:36.176674 30979 raft_consensus.cc:740] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ee535d959434d6b946dd4cd41edba1a, State: Initialized, Role: FOLLOWER
I20251211 21:02:36.176785 30979 consensus_queue.cc:260] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } }
I20251211 21:02:36.176859 30979 raft_consensus.cc:399] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:36.176887 30979 raft_consensus.cc:493] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:36.176925 30979 raft_consensus.cc:3060] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:36.177066 30980 raft_consensus.cc:515] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2526700d3464444b6351a3f782088e4" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46385 } }
I20251211 21:02:36.177173 30980 leader_election.cc:304] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2526700d3464444b6351a3f782088e4; no voters:
I20251211 21:02:36.177371 30980 leader_election.cc:290] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:36.177469 30983 raft_consensus.cc:2804] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:36.177668 30983 raft_consensus.cc:697] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 1 LEADER]: Becoming Leader. State: Replica: f2526700d3464444b6351a3f782088e4, State: Running, Role: LEADER
I20251211 21:02:36.177690 30980 ts_tablet_manager.cc:1434] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251211 21:02:36.177783 30983 consensus_queue.cc:237] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2526700d3464444b6351a3f782088e4" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46385 } }
I20251211 21:02:36.178485 30986 tablet_bootstrap.cc:492] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4: Bootstrap starting.
I20251211 21:02:36.178485 30979 raft_consensus.cc:515] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } }
I20251211 21:02:36.178650 30979 leader_election.cc:304] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ee535d959434d6b946dd4cd41edba1a; no voters:
I20251211 21:02:36.178825 30979 leader_election.cc:290] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:36.179097 30979 ts_tablet_manager.cc:1434] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:02:36.179303 30979 tablet_bootstrap.cc:492] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a: Bootstrap starting.
I20251211 21:02:36.180141 30979 tablet_bootstrap.cc:654] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:36.181349 30986 tablet_bootstrap.cc:654] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:36.181206 30620 catalog_manager.cc:5654] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2526700d3464444b6351a3f782088e4 (127.29.190.194). New cstate: current_term: 1 leader_uuid: "f2526700d3464444b6351a3f782088e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2526700d3464444b6351a3f782088e4" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46385 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:36.182334 30986 tablet_bootstrap.cc:492] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4: No bootstrap required, opened a new log
I20251211 21:02:36.184062 30988 raft_consensus.cc:2804] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:36.184621 30986 ts_tablet_manager.cc:1403] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251211 21:02:36.184602 30988 raft_consensus.cc:697] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 1 LEADER]: Becoming Leader. State: Replica: 1ee535d959434d6b946dd4cd41edba1a, State: Running, Role: LEADER
I20251211 21:02:36.184758 30988 consensus_queue.cc:237] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } }
I20251211 21:02:36.185159 30986 raft_consensus.cc:359] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8058d82e7142ac9e3dd86d6abc68f4" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 43777 } }
I20251211 21:02:36.185242 30986 raft_consensus.cc:385] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:36.185276 30986 raft_consensus.cc:740] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8058d82e7142ac9e3dd86d6abc68f4, State: Initialized, Role: FOLLOWER
I20251211 21:02:36.185387 30986 consensus_queue.cc:260] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8058d82e7142ac9e3dd86d6abc68f4" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 43777 } }
I20251211 21:02:36.185465 30986 raft_consensus.cc:399] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:36.185503 30986 raft_consensus.cc:493] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:36.185557 30986 raft_consensus.cc:3060] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:36.186028 30620 catalog_manager.cc:5654] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ee535d959434d6b946dd4cd41edba1a (127.29.190.193). New cstate: current_term: 1 leader_uuid: "1ee535d959434d6b946dd4cd41edba1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:36.186483 30986 raft_consensus.cc:515] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8058d82e7142ac9e3dd86d6abc68f4" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 43777 } }
I20251211 21:02:36.186607 30986 leader_election.cc:304] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf8058d82e7142ac9e3dd86d6abc68f4; no voters:
I20251211 21:02:36.186776 30986 leader_election.cc:290] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:36.187057 30986 ts_tablet_manager.cc:1434] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:36.190409 30996 raft_consensus.cc:2804] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:36.190706 30996 raft_consensus.cc:697] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 1 LEADER]: Becoming Leader. State: Replica: bf8058d82e7142ac9e3dd86d6abc68f4, State: Running, Role: LEADER
I20251211 21:02:36.190903 30996 consensus_queue.cc:237] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8058d82e7142ac9e3dd86d6abc68f4" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 43777 } }
I20251211 21:02:36.193341 30620 catalog_manager.cc:5654] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8058d82e7142ac9e3dd86d6abc68f4 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "bf8058d82e7142ac9e3dd86d6abc68f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8058d82e7142ac9e3dd86d6abc68f4" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 43777 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:36.216110 30979 tablet_bootstrap.cc:492] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a: No bootstrap required, opened a new log
I20251211 21:02:36.216246 30979 ts_tablet_manager.cc:1403] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.000s
I20251211 21:02:36.216737 30979 raft_consensus.cc:359] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } }
I20251211 21:02:36.216846 30979 raft_consensus.cc:385] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:36.216879 30979 raft_consensus.cc:740] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ee535d959434d6b946dd4cd41edba1a, State: Initialized, Role: FOLLOWER
I20251211 21:02:36.217012 30979 consensus_queue.cc:260] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } }
I20251211 21:02:36.217080 30979 raft_consensus.cc:399] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:36.217116 30979 raft_consensus.cc:493] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:36.217161 30979 raft_consensus.cc:3060] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:36.217981 30979 raft_consensus.cc:515] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } }
I20251211 21:02:36.218134 30979 leader_election.cc:304] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ee535d959434d6b946dd4cd41edba1a; no voters:
I20251211 21:02:36.218232 30979 leader_election.cc:290] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:36.218338 30989 raft_consensus.cc:2804] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:36.218477 30989 raft_consensus.cc:697] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 1 LEADER]: Becoming Leader. State: Replica: 1ee535d959434d6b946dd4cd41edba1a, State: Running, Role: LEADER
I20251211 21:02:36.218488 30979 ts_tablet_manager.cc:1434] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251211 21:02:36.218606 30989 consensus_queue.cc:237] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } }
I20251211 21:02:36.220068 30620 catalog_manager.cc:5654] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ee535d959434d6b946dd4cd41edba1a (127.29.190.193). New cstate: current_term: 1 leader_uuid: "1ee535d959434d6b946dd4cd41edba1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ee535d959434d6b946dd4cd41edba1a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45473 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:36.238517 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:02:36.242533 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:36.242880 30459 tablet_replica.cc:333] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a: stopping tablet replica
I20251211 21:02:36.243099 30459 raft_consensus.cc:2243] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:36.243237 30459 raft_consensus.cc:2272] T 9a56c7e9f85b48d687ec877a50c38c89 P 1ee535d959434d6b946dd4cd41edba1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:36.244364 30459 tablet_replica.cc:333] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a: stopping tablet replica
I20251211 21:02:36.244451 30459 raft_consensus.cc:2243] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:36.244554 30459 raft_consensus.cc:2272] T fd317f97518049d8a459d588a9763435 P 1ee535d959434d6b946dd4cd41edba1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:36.258255 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:02:36.262342 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:02:36.265436 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:36.265872 30459 tablet_replica.cc:333] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4: stopping tablet replica
I20251211 21:02:36.266003 30459 raft_consensus.cc:2243] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:36.266116 30459 raft_consensus.cc:2272] T eecd31e10a674c4eb24a8ec6d90aa501 P f2526700d3464444b6351a3f782088e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:36.279364 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:02:36.281525 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:02:36.285300 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:36.285568 30459 tablet_replica.cc:333] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4: stopping tablet replica
I20251211 21:02:36.285686 30459 raft_consensus.cc:2243] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:36.285801 30459 raft_consensus.cc:2272] T cae84f2d627b40d6b68761b294ab08ca P bf8058d82e7142ac9e3dd86d6abc68f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:36.299165 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:02:36.301311 30459 master.cc:561] Master@127.29.190.254:38767 shutting down...
I20251211 21:02:36.304759 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:36.304926 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:36.304986 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7cb0082e2e84466d986261e576007058: stopping tablet replica
I20251211 21:02:36.318089 30459 master.cc:583] Master@127.29.190.254:38767 shutdown complete.
I20251211 21:02:36.321781 30459 master.cc:561] Master@127.29.190.253:34837 shutting down...
I20251211 21:02:36.324623 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:36.324781 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:36.324832 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P a704668e14604bd5bdf2852f9f2e4d5d: stopping tablet replica
I20251211 21:02:36.337589 30459 master.cc:583] Master@127.29.190.253:34837 shutdown complete.
I20251211 21:02:36.340024 30459 master.cc:561] Master@127.29.190.252:37267 shutting down...
I20251211 21:02:36.343730 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:36.344059 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:36.344132 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P f2d5ebd1eca949e9afcce28b507b13cf: stopping tablet replica
I20251211 21:02:36.357493 30459 master.cc:583] Master@127.29.190.252:37267 shutdown complete.
[ OK ] AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing (2557 ms)
[ RUN ] AutoRebalancerTest.AutoRebalancingTurnOffAndOn
I20251211 21:02:36.364919 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:41817
I20251211 21:02:36.365283 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:36.366807 31002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:36.366907 31005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:36.367259 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:36.367267 31003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:36.367486 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:36.367527 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:36.367547 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486956367546 us; error 0 us; skew 500 ppm
I20251211 21:02:36.368366 30459 webserver.cc:492] Webserver started at http://127.29.190.254:35269/ using document root <none> and password file <none>
I20251211 21:02:36.368505 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:36.368556 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:36.368713 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:36.369145 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "f5abeebabe7d4cdda2700d577343a6e7"
format_stamp: "Formatted at 2025-12-11 21:02:36 on dist-test-slave-xjj2"
I20251211 21:02:36.370595 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:02:36.371480 31010 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.371783 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:36.371848 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "f5abeebabe7d4cdda2700d577343a6e7"
format_stamp: "Formatted at 2025-12-11 21:02:36 on dist-test-slave-xjj2"
I20251211 21:02:36.371917 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:36.377763 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:36.378129 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:36.382016 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:41817
I20251211 21:02:36.384414 31062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:41817 every 8 connection(s)
I20251211 21:02:36.384857 31063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:36.386644 31063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7: Bootstrap starting.
I20251211 21:02:36.387415 31063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:36.388447 31063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7: No bootstrap required, opened a new log
I20251211 21:02:36.388790 31063 raft_consensus.cc:359] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abeebabe7d4cdda2700d577343a6e7" member_type: VOTER }
I20251211 21:02:36.388875 31063 raft_consensus.cc:385] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:36.388895 31063 raft_consensus.cc:740] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5abeebabe7d4cdda2700d577343a6e7, State: Initialized, Role: FOLLOWER
I20251211 21:02:36.389006 31063 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abeebabe7d4cdda2700d577343a6e7" member_type: VOTER }
I20251211 21:02:36.389083 31063 raft_consensus.cc:399] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:36.389113 31063 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:36.389146 31063 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:36.389794 31063 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abeebabe7d4cdda2700d577343a6e7" member_type: VOTER }
I20251211 21:02:36.389906 31063 leader_election.cc:304] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5abeebabe7d4cdda2700d577343a6e7; no voters:
I20251211 21:02:36.390058 31063 leader_election.cc:290] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:36.390205 31066 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:36.390467 31063 sys_catalog.cc:565] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:02:36.390475 31066 raft_consensus.cc:697] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 1 LEADER]: Becoming Leader. State: Replica: f5abeebabe7d4cdda2700d577343a6e7, State: Running, Role: LEADER
I20251211 21:02:36.390636 31066 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abeebabe7d4cdda2700d577343a6e7" member_type: VOTER }
I20251211 21:02:36.391048 31067 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5abeebabe7d4cdda2700d577343a6e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abeebabe7d4cdda2700d577343a6e7" member_type: VOTER } }
I20251211 21:02:36.391093 31068 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5abeebabe7d4cdda2700d577343a6e7. Latest consensus state: current_term: 1 leader_uuid: "f5abeebabe7d4cdda2700d577343a6e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abeebabe7d4cdda2700d577343a6e7" member_type: VOTER } }
I20251211 21:02:36.391219 31068 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:36.391466 31074 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:02:36.391808 31067 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:36.392355 31074 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:02:36.392611 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:02:36.394214 31074 catalog_manager.cc:1357] Generated new cluster ID: 8cbf006dd50044039335ce6f5692bb0c
I20251211 21:02:36.394304 31074 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:02:36.406482 31074 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:02:36.407083 31074 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:02:36.412967 31074 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7: Generated new TSK 0
I20251211 21:02:36.413187 31074 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:02:36.425030 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:36.426898 31085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:36.426956 31084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:36.427054 31087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:36.427371 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:36.427520 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:36.427556 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:36.427627 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486956427627 us; error 0 us; skew 500 ppm
I20251211 21:02:36.428476 30459 webserver.cc:492] Webserver started at http://127.29.190.193:38627/ using document root <none> and password file <none>
I20251211 21:02:36.428642 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:36.428695 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:36.428776 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:36.429155 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "a111e3870dd24874898956eae1a9471d"
format_stamp: "Formatted at 2025-12-11 21:02:36 on dist-test-slave-xjj2"
I20251211 21:02:36.430601 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:02:36.431476 31092 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.431715 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:36.431782 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "a111e3870dd24874898956eae1a9471d"
format_stamp: "Formatted at 2025-12-11 21:02:36 on dist-test-slave-xjj2"
I20251211 21:02:36.431851 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:36.438611 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:36.439039 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:36.439313 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:36.439828 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:36.439872 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.439913 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:36.439939 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.444013 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:41273
I20251211 21:02:36.444034 31155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:41273 every 8 connection(s)
I20251211 21:02:36.444921 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:36.446856 31163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:36.446897 31160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:36.447010 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:36.447093 31161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:36.447317 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:36.447382 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:36.447403 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486956447402 us; error 0 us; skew 500 ppm
I20251211 21:02:36.448338 30459 webserver.cc:492] Webserver started at http://127.29.190.194:36773/ using document root <none> and password file <none>
I20251211 21:02:36.448503 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:36.448575 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:36.448660 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:36.449122 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "7a1eb7ef7f2549668a98ce687988cdab"
format_stamp: "Formatted at 2025-12-11 21:02:36 on dist-test-slave-xjj2"
I20251211 21:02:36.449662 31156 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41817
I20251211 21:02:36.449766 31156 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:36.450023 31156 heartbeater.cc:507] Master 127.29.190.254:41817 requested a full tablet report, sending...
I20251211 21:02:36.450700 31027 ts_manager.cc:194] Registered new tserver with Master: a111e3870dd24874898956eae1a9471d (127.29.190.193:41273)
I20251211 21:02:36.450908 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:36.451485 31027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60012
I20251211 21:02:36.451958 31168 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.452201 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:36.452260 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "7a1eb7ef7f2549668a98ce687988cdab"
format_stamp: "Formatted at 2025-12-11 21:02:36 on dist-test-slave-xjj2"
I20251211 21:02:36.452339 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:36.464180 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:36.464610 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:36.464888 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:36.465375 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:36.465415 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.465448 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:36.465476 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.469468 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:45801
I20251211 21:02:36.469540 31231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:45801 every 8 connection(s)
I20251211 21:02:36.470279 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:36.472223 31235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:36.472255 31238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:36.472232 31236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:36.472529 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:36.472728 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:36.472764 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:36.472783 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486956472782 us; error 0 us; skew 500 ppm
I20251211 21:02:36.473752 30459 webserver.cc:492] Webserver started at http://127.29.190.195:37313/ using document root <none> and password file <none>
I20251211 21:02:36.473917 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:36.473980 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:36.474058 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:36.474519 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "a734808ce5ad4def8838a47d6bd72296"
format_stamp: "Formatted at 2025-12-11 21:02:36 on dist-test-slave-xjj2"
I20251211 21:02:36.474620 31232 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41817
I20251211 21:02:36.474718 31232 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:36.474941 31232 heartbeater.cc:507] Master 127.29.190.254:41817 requested a full tablet report, sending...
I20251211 21:02:36.475567 31027 ts_manager.cc:194] Registered new tserver with Master: 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:36.476106 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:02:36.476210 31027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60014
I20251211 21:02:36.477064 31243 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.477281 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:36.477341 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "a734808ce5ad4def8838a47d6bd72296"
format_stamp: "Formatted at 2025-12-11 21:02:36 on dist-test-slave-xjj2"
I20251211 21:02:36.477407 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:36.488070 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:36.488514 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:36.488817 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:36.489279 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:36.489323 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.489355 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:36.489369 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:36.493860 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:33991
I20251211 21:02:36.493908 31306 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:33991 every 8 connection(s)
I20251211 21:02:36.498077 31307 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41817
I20251211 21:02:36.498185 31307 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:36.498425 31307 heartbeater.cc:507] Master 127.29.190.254:41817 requested a full tablet report, sending...
I20251211 21:02:36.499017 31027 ts_manager.cc:194] Registered new tserver with Master: a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:36.499531 31027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60016
I20251211 21:02:36.499866 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005615353s
I20251211 21:02:37.452538 31156 heartbeater.cc:499] Master 127.29.190.254:41817 was elected leader, sending a full tablet report...
I20251211 21:02:37.477202 31232 heartbeater.cc:499] Master 127.29.190.254:41817 was elected leader, sending a full tablet report...
I20251211 21:02:37.500427 31307 heartbeater.cc:499] Master 127.29.190.254:41817 was elected leader, sending a full tablet report...
I20251211 21:02:37.525949 30459 test_util.cc:276] Using random seed: 1995799481
I20251211 21:02:37.533707 31027 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60030:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\017\004\001\000\376\377\377\037\004\001\000\375\377\377/\004\001\000\374\377\377?\004\001\000\373\377\377O\004\001\000\372\377\377_\004\001\000\371\377\377o""\004\001\000\377\377\377\017\004\001\000\376\377\377\037\004\001\000\375\377\377/\004\001\000\374\377\377?\004\001\000\373\377\377O\004\001\000\372\377\377_\004\001\000\371\377\377o"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:02:37.534323 31027 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:02:37.546512 31120 tablet_service.cc:1505] Processing CreateTablet for tablet 1a6304e9819242098a743ae33f8c2374 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION VALUES < 268435455
I20251211 21:02:37.546881 31120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6304e9819242098a743ae33f8c2374. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.547070 31115 tablet_service.cc:1505] Processing CreateTablet for tablet b072ef29fc744eb9a9bf2726a91febb3 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1342177275 <= VALUES < 1610612730
I20251211 21:02:37.547351 31115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b072ef29fc744eb9a9bf2726a91febb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.547775 31271 tablet_service.cc:1505] Processing CreateTablet for tablet 1a6304e9819242098a743ae33f8c2374 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION VALUES < 268435455
I20251211 21:02:37.547821 31116 tablet_service.cc:1505] Processing CreateTablet for tablet 7260db8fc77248b8a7f3c858a82d1ec9 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1342177275
I20251211 21:02:37.548015 31271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6304e9819242098a743ae33f8c2374. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.548072 31116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7260db8fc77248b8a7f3c858a82d1ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.548137 31265 tablet_service.cc:1505] Processing CreateTablet for tablet 2275bfbd88fd4564b2b6adec7dc84666 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1879048185
I20251211 21:02:37.548358 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2275bfbd88fd4564b2b6adec7dc84666. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.549558 31270 tablet_service.cc:1505] Processing CreateTablet for tablet 8d9d6e6927de430c91237620fd4945c6 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 268435455 <= VALUES < 536870910
I20251211 21:02:37.549786 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9d6e6927de430c91237620fd4945c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.550304 31269 tablet_service.cc:1505] Processing CreateTablet for tablet 13336733598e4be6a220fbb5dcbe9a4f (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 805306365
I20251211 21:02:37.550544 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13336733598e4be6a220fbb5dcbe9a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.550501 31118 tablet_service.cc:1505] Processing CreateTablet for tablet 13336733598e4be6a220fbb5dcbe9a4f (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 805306365
I20251211 21:02:37.550752 31118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13336733598e4be6a220fbb5dcbe9a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.551577 31271 tablet_service.cc:1505] Processing CreateTablet for tablet 8fdff0ae90d7434994682a337d6f1109 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1879048185 <= VALUES
I20251211 21:02:37.551813 31271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fdff0ae90d7434994682a337d6f1109. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.551841 31119 tablet_service.cc:1505] Processing CreateTablet for tablet 8d9d6e6927de430c91237620fd4945c6 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 268435455 <= VALUES < 536870910
I20251211 21:02:37.551980 31116 tablet_service.cc:1505] Processing CreateTablet for tablet 8fdff0ae90d7434994682a337d6f1109 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1879048185 <= VALUES
I20251211 21:02:37.552037 31119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9d6e6927de430c91237620fd4945c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.552248 31114 tablet_service.cc:1505] Processing CreateTablet for tablet 2275bfbd88fd4564b2b6adec7dc84666 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1879048185
I20251211 21:02:37.552490 31114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2275bfbd88fd4564b2b6adec7dc84666. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.552533 31268 tablet_service.cc:1505] Processing CreateTablet for tablet 679e7f1b63d44ac8b184e09ed666d19e (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 805306365 <= VALUES < 1073741820
I20251211 21:02:37.552742 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679e7f1b63d44ac8b184e09ed666d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.554147 31116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fdff0ae90d7434994682a337d6f1109. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.554816 31267 tablet_service.cc:1505] Processing CreateTablet for tablet 7260db8fc77248b8a7f3c858a82d1ec9 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1342177275
I20251211 21:02:37.550308 31117 tablet_service.cc:1505] Processing CreateTablet for tablet 679e7f1b63d44ac8b184e09ed666d19e (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 805306365 <= VALUES < 1073741820
I20251211 21:02:37.555081 31267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7260db8fc77248b8a7f3c858a82d1ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.555120 31117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679e7f1b63d44ac8b184e09ed666d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.556326 31327 tablet_bootstrap.cc:492] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d: Bootstrap starting.
I20251211 21:02:37.557144 31266 tablet_service.cc:1505] Processing CreateTablet for tablet b072ef29fc744eb9a9bf2726a91febb3 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1342177275 <= VALUES < 1610612730
I20251211 21:02:37.557305 31327 tablet_bootstrap.cc:654] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.557381 31266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b072ef29fc744eb9a9bf2726a91febb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.558265 31328 tablet_bootstrap.cc:492] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296: Bootstrap starting.
I20251211 21:02:37.559298 31328 tablet_bootstrap.cc:654] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.560155 31327 tablet_bootstrap.cc:492] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d: No bootstrap required, opened a new log
I20251211 21:02:37.560315 31327 ts_tablet_manager.cc:1403] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:02:37.560377 31328 tablet_bootstrap.cc:492] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296: No bootstrap required, opened a new log
I20251211 21:02:37.560459 31196 tablet_service.cc:1505] Processing CreateTablet for tablet 1a6304e9819242098a743ae33f8c2374 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION VALUES < 268435455
I20251211 21:02:37.560719 31196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6304e9819242098a743ae33f8c2374. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.560699 31194 tablet_service.cc:1505] Processing CreateTablet for tablet 13336733598e4be6a220fbb5dcbe9a4f (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 805306365
I20251211 21:02:37.560860 31195 tablet_service.cc:1505] Processing CreateTablet for tablet 8d9d6e6927de430c91237620fd4945c6 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 268435455 <= VALUES < 536870910
I20251211 21:02:37.560475 31328 ts_tablet_manager.cc:1403] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:02:37.561102 31327 raft_consensus.cc:359] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.561120 31193 tablet_service.cc:1505] Processing CreateTablet for tablet 679e7f1b63d44ac8b184e09ed666d19e (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 805306365 <= VALUES < 1073741820
I20251211 21:02:37.561329 31327 raft_consensus.cc:385] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.561372 31328 raft_consensus.cc:359] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.561461 31327 raft_consensus.cc:740] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.561497 31328 raft_consensus.cc:385] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.561532 31328 raft_consensus.cc:740] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.561581 31190 tablet_service.cc:1505] Processing CreateTablet for tablet 2275bfbd88fd4564b2b6adec7dc84666 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1879048185
I20251211 21:02:37.561591 31327 consensus_queue.cc:260] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.561640 31328 consensus_queue.cc:260] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.562004 31328 ts_tablet_manager.cc:1434] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.562006 31327 ts_tablet_manager.cc:1434] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:02:37.562247 31327 tablet_bootstrap.cc:492] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d: Bootstrap starting.
I20251211 21:02:37.562288 31192 tablet_service.cc:1505] Processing CreateTablet for tablet 7260db8fc77248b8a7f3c858a82d1ec9 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1342177275
I20251211 21:02:37.561372 31189 tablet_service.cc:1505] Processing CreateTablet for tablet 8fdff0ae90d7434994682a337d6f1109 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1879048185 <= VALUES
I20251211 21:02:37.560917 31194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13336733598e4be6a220fbb5dcbe9a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.562856 31192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7260db8fc77248b8a7f3c858a82d1ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.561993 31191 tablet_service.cc:1505] Processing CreateTablet for tablet b072ef29fc744eb9a9bf2726a91febb3 (DEFAULT_TABLE table=test-workload [id=2b8a503b07b848768bc8ef528df3d9e0]), partition=RANGE (key) PARTITION 1342177275 <= VALUES < 1610612730
I20251211 21:02:37.563069 31191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b072ef29fc744eb9a9bf2726a91febb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.563223 31195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9d6e6927de430c91237620fd4945c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.563557 31190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2275bfbd88fd4564b2b6adec7dc84666. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.564199 31327 tablet_bootstrap.cc:654] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.564965 31334 tablet_bootstrap.cc:492] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab: Bootstrap starting.
I20251211 21:02:37.565455 31189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fdff0ae90d7434994682a337d6f1109. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.565989 31334 tablet_bootstrap.cc:654] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.566955 31193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679e7f1b63d44ac8b184e09ed666d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:37.567150 31334 tablet_bootstrap.cc:492] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab: No bootstrap required, opened a new log
I20251211 21:02:37.567227 31334 ts_tablet_manager.cc:1403] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:37.567693 31334 raft_consensus.cc:359] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.567795 31334 raft_consensus.cc:385] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.567827 31334 raft_consensus.cc:740] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.567934 31334 consensus_queue.cc:260] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.568426 31334 ts_tablet_manager.cc:1434] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:02:37.568580 31334 tablet_bootstrap.cc:492] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab: Bootstrap starting.
I20251211 21:02:37.562247 31328 tablet_bootstrap.cc:492] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296: Bootstrap starting.
I20251211 21:02:37.570335 31334 tablet_bootstrap.cc:654] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.571012 31328 tablet_bootstrap.cc:654] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.571708 31334 tablet_bootstrap.cc:492] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab: No bootstrap required, opened a new log
I20251211 21:02:37.572048 31328 tablet_bootstrap.cc:492] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296: No bootstrap required, opened a new log
I20251211 21:02:37.572094 31327 tablet_bootstrap.cc:492] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d: No bootstrap required, opened a new log
I20251211 21:02:37.572119 31328 ts_tablet_manager.cc:1403] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20251211 21:02:37.572173 31327 ts_tablet_manager.cc:1403] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251211 21:02:37.572522 31328 raft_consensus.cc:359] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.572554 31327 raft_consensus.cc:359] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.572628 31328 raft_consensus.cc:385] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.572681 31328 raft_consensus.cc:740] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.572635 31327 raft_consensus.cc:385] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.572671 31334 ts_tablet_manager.cc:1403] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251211 21:02:37.572724 31327 raft_consensus.cc:740] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.572806 31328 consensus_queue.cc:260] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.573055 31328 ts_tablet_manager.cc:1434] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.572819 31327 consensus_queue.cc:260] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.573125 31334 raft_consensus.cc:359] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.573259 31327 ts_tablet_manager.cc:1434] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:37.573266 31328 tablet_bootstrap.cc:492] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296: Bootstrap starting.
I20251211 21:02:37.573473 31327 tablet_bootstrap.cc:492] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d: Bootstrap starting.
I20251211 21:02:37.573261 31334 raft_consensus.cc:385] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.573689 31334 raft_consensus.cc:740] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.573818 31334 consensus_queue.cc:260] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.574055 31334 ts_tablet_manager.cc:1434] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.574286 31327 tablet_bootstrap.cc:654] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.574313 31328 tablet_bootstrap.cc:654] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.575950 31334 tablet_bootstrap.cc:492] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab: Bootstrap starting.
I20251211 21:02:37.576946 31334 tablet_bootstrap.cc:654] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.578109 31328 tablet_bootstrap.cc:492] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296: No bootstrap required, opened a new log
I20251211 21:02:37.578109 31334 tablet_bootstrap.cc:492] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab: No bootstrap required, opened a new log
I20251211 21:02:37.578176 31327 tablet_bootstrap.cc:492] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d: No bootstrap required, opened a new log
I20251211 21:02:37.578203 31328 ts_tablet_manager.cc:1403] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20251211 21:02:37.578289 31327 ts_tablet_manager.cc:1403] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251211 21:02:37.578204 31334 ts_tablet_manager.cc:1403] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:02:37.578697 31328 raft_consensus.cc:359] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.578753 31334 raft_consensus.cc:359] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.578802 31328 raft_consensus.cc:385] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.578816 31334 raft_consensus.cc:385] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.578771 31327 raft_consensus.cc:359] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.578835 31328 raft_consensus.cc:740] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.578845 31334 raft_consensus.cc:740] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.578866 31327 raft_consensus.cc:385] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.578888 31327 raft_consensus.cc:740] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.578943 31334 consensus_queue.cc:260] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.578941 31328 consensus_queue.cc:260] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.579003 31327 consensus_queue.cc:260] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.579219 31328 ts_tablet_manager.cc:1434] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.579396 31328 tablet_bootstrap.cc:492] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296: Bootstrap starting.
I20251211 21:02:37.579219 31334 ts_tablet_manager.cc:1434] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.579566 31327 ts_tablet_manager.cc:1434] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:02:37.579700 31334 tablet_bootstrap.cc:492] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab: Bootstrap starting.
I20251211 21:02:37.579746 31327 tablet_bootstrap.cc:492] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d: Bootstrap starting.
I20251211 21:02:37.580507 31328 tablet_bootstrap.cc:654] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.580529 31334 tablet_bootstrap.cc:654] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.580688 31327 tablet_bootstrap.cc:654] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.581534 31328 tablet_bootstrap.cc:492] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296: No bootstrap required, opened a new log
I20251211 21:02:37.581627 31328 ts_tablet_manager.cc:1403] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:37.581733 31327 tablet_bootstrap.cc:492] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d: No bootstrap required, opened a new log
I20251211 21:02:37.581822 31327 ts_tablet_manager.cc:1403] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:37.582046 31328 raft_consensus.cc:359] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.582145 31328 raft_consensus.cc:385] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.582177 31328 raft_consensus.cc:740] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.582227 31327 raft_consensus.cc:359] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.582310 31327 raft_consensus.cc:385] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.582297 31328 consensus_queue.cc:260] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.582340 31327 raft_consensus.cc:740] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.582535 31328 ts_tablet_manager.cc:1434] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:02:37.582500 31327 consensus_queue.cc:260] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.582702 31328 tablet_bootstrap.cc:492] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296: Bootstrap starting.
I20251211 21:02:37.582814 31327 ts_tablet_manager.cc:1434] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:37.582978 31327 tablet_bootstrap.cc:492] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d: Bootstrap starting.
I20251211 21:02:37.583659 31328 tablet_bootstrap.cc:654] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.583907 31327 tablet_bootstrap.cc:654] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.584882 31327 tablet_bootstrap.cc:492] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d: No bootstrap required, opened a new log
I20251211 21:02:37.584946 31327 ts_tablet_manager.cc:1403] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:02:37.585263 31327 raft_consensus.cc:359] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.585358 31327 raft_consensus.cc:385] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.585393 31327 raft_consensus.cc:740] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.585465 31334 tablet_bootstrap.cc:492] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab: No bootstrap required, opened a new log
I20251211 21:02:37.585530 31334 ts_tablet_manager.cc:1403] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251211 21:02:37.585508 31327 consensus_queue.cc:260] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.585680 31328 tablet_bootstrap.cc:492] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296: No bootstrap required, opened a new log
I20251211 21:02:37.585754 31328 ts_tablet_manager.cc:1403] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:02:37.585799 31327 ts_tablet_manager.cc:1434] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:37.585893 31334 raft_consensus.cc:359] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.585948 31327 tablet_bootstrap.cc:492] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d: Bootstrap starting.
I20251211 21:02:37.585974 31334 raft_consensus.cc:385] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.586002 31334 raft_consensus.cc:740] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.586105 31334 consensus_queue.cc:260] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.586139 31328 raft_consensus.cc:359] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.586246 31328 raft_consensus.cc:385] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.586274 31328 raft_consensus.cc:740] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.586357 31334 ts_tablet_manager.cc:1434] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:02:37.586398 31328 consensus_queue.cc:260] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.586503 31334 tablet_bootstrap.cc:492] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab: Bootstrap starting.
I20251211 21:02:37.586941 31328 ts_tablet_manager.cc:1434] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.587101 31328 tablet_bootstrap.cc:492] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296: Bootstrap starting.
I20251211 21:02:37.587412 31334 tablet_bootstrap.cc:654] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.587412 31327 tablet_bootstrap.cc:654] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.588089 31328 tablet_bootstrap.cc:654] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.589139 31328 tablet_bootstrap.cc:492] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296: No bootstrap required, opened a new log
I20251211 21:02:37.589237 31328 ts_tablet_manager.cc:1403] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:02:37.589699 31328 raft_consensus.cc:359] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.589809 31328 raft_consensus.cc:385] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.589850 31328 raft_consensus.cc:740] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.589962 31328 consensus_queue.cc:260] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.590183 31328 ts_tablet_manager.cc:1434] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.590335 31328 tablet_bootstrap.cc:492] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296: Bootstrap starting.
I20251211 21:02:37.591290 31328 tablet_bootstrap.cc:654] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.592331 31328 tablet_bootstrap.cc:492] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296: No bootstrap required, opened a new log
I20251211 21:02:37.592360 31334 tablet_bootstrap.cc:492] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab: No bootstrap required, opened a new log
I20251211 21:02:37.592414 31328 ts_tablet_manager.cc:1403] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:37.592440 31334 ts_tablet_manager.cc:1403] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251211 21:02:37.592808 31328 raft_consensus.cc:359] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.592839 31334 raft_consensus.cc:359] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.592908 31328 raft_consensus.cc:385] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.592932 31334 raft_consensus.cc:385] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.592941 31328 raft_consensus.cc:740] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.592976 31334 raft_consensus.cc:740] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.593087 31334 consensus_queue.cc:260] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.593087 31328 consensus_queue.cc:260] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.593389 31334 ts_tablet_manager.cc:1434] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:02:37.593436 31327 tablet_bootstrap.cc:492] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d: No bootstrap required, opened a new log
I20251211 21:02:37.593519 31327 ts_tablet_manager.cc:1403] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20251211 21:02:37.593569 31334 tablet_bootstrap.cc:492] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab: Bootstrap starting.
I20251211 21:02:37.593669 31328 ts_tablet_manager.cc:1434] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:37.593853 31328 tablet_bootstrap.cc:492] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296: Bootstrap starting.
I20251211 21:02:37.593912 31327 raft_consensus.cc:359] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.593994 31327 raft_consensus.cc:385] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.594028 31327 raft_consensus.cc:740] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.594179 31327 consensus_queue.cc:260] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.594434 31327 ts_tablet_manager.cc:1434] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.594578 31334 tablet_bootstrap.cc:654] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.594604 31327 tablet_bootstrap.cc:492] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d: Bootstrap starting.
I20251211 21:02:37.595088 31328 tablet_bootstrap.cc:654] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.595463 31327 tablet_bootstrap.cc:654] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.595692 31334 tablet_bootstrap.cc:492] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab: No bootstrap required, opened a new log
I20251211 21:02:37.595785 31334 ts_tablet_manager.cc:1403] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251211 21:02:37.596199 31334 raft_consensus.cc:359] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.596312 31334 raft_consensus.cc:385] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.596352 31334 raft_consensus.cc:740] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.596465 31334 consensus_queue.cc:260] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.596522 31327 tablet_bootstrap.cc:492] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d: No bootstrap required, opened a new log
I20251211 21:02:37.596601 31327 ts_tablet_manager.cc:1403] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251211 21:02:37.596717 31334 ts_tablet_manager.cc:1434] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:37.596890 31334 tablet_bootstrap.cc:492] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab: Bootstrap starting.
I20251211 21:02:37.597323 31327 raft_consensus.cc:359] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.597415 31327 raft_consensus.cc:385] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.597450 31327 raft_consensus.cc:740] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.597574 31327 consensus_queue.cc:260] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.597824 31334 tablet_bootstrap.cc:654] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.597889 31327 ts_tablet_manager.cc:1434] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.598037 31327 tablet_bootstrap.cc:492] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d: Bootstrap starting.
I20251211 21:02:37.598883 31327 tablet_bootstrap.cc:654] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.598968 31334 tablet_bootstrap.cc:492] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab: No bootstrap required, opened a new log
I20251211 21:02:37.599057 31334 ts_tablet_manager.cc:1403] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:37.599507 31334 raft_consensus.cc:359] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.599637 31334 raft_consensus.cc:385] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.599685 31334 raft_consensus.cc:740] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.599797 31334 consensus_queue.cc:260] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.599887 31327 tablet_bootstrap.cc:492] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d: No bootstrap required, opened a new log
I20251211 21:02:37.599959 31327 ts_tablet_manager.cc:1403] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:02:37.600075 31334 ts_tablet_manager.cc:1434] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:37.600247 31334 tablet_bootstrap.cc:492] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab: Bootstrap starting.
I20251211 21:02:37.600335 31327 raft_consensus.cc:359] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.600448 31327 raft_consensus.cc:385] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.600482 31327 raft_consensus.cc:740] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.600590 31327 consensus_queue.cc:260] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.600826 31327 ts_tablet_manager.cc:1434] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:37.601212 31334 tablet_bootstrap.cc:654] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:37.602449 31334 tablet_bootstrap.cc:492] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab: No bootstrap required, opened a new log
I20251211 21:02:37.602592 31334 ts_tablet_manager.cc:1403] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:37.603050 31334 raft_consensus.cc:359] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.603159 31334 raft_consensus.cc:385] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.603201 31334 raft_consensus.cc:740] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.603305 31334 consensus_queue.cc:260] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.603547 31334 ts_tablet_manager.cc:1434] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:02:37.603726 31328 tablet_bootstrap.cc:492] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296: No bootstrap required, opened a new log
I20251211 21:02:37.603817 31328 ts_tablet_manager.cc:1403] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251211 21:02:37.604225 31328 raft_consensus.cc:359] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.604334 31328 raft_consensus.cc:385] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:37.604367 31328 raft_consensus.cc:740] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Initialized, Role: FOLLOWER
I20251211 21:02:37.604486 31328 consensus_queue.cc:260] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.604744 31328 ts_tablet_manager.cc:1434] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:02:37.644588 31336 raft_consensus.cc:493] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:37.644742 31336 raft_consensus.cc:515] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.645288 31336 leader_election.cc:290] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:37.648214 31331 raft_consensus.cc:493] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:37.648335 31331 raft_consensus.cc:515] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.648862 31331 leader_election.cc:290] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:37.649646 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b072ef29fc744eb9a9bf2726a91febb3" candidate_uuid: "7a1eb7ef7f2549668a98ce687988cdab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296" is_pre_election: true
I20251211 21:02:37.649778 31281 raft_consensus.cc:2468] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a1eb7ef7f2549668a98ce687988cdab in term 0.
I20251211 21:02:37.649854 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b072ef29fc744eb9a9bf2726a91febb3" candidate_uuid: "7a1eb7ef7f2549668a98ce687988cdab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a111e3870dd24874898956eae1a9471d" is_pre_election: true
I20251211 21:02:37.649976 31130 raft_consensus.cc:2468] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a1eb7ef7f2549668a98ce687988cdab in term 0.
I20251211 21:02:37.650099 31170 leader_election.cc:304] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.650255 31336 raft_consensus.cc:2804] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:37.650312 31336 raft_consensus.cc:493] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:37.650352 31336 raft_consensus.cc:3060] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.651424 31336 raft_consensus.cc:515] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.651804 31336 leader_election.cc:290] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [CANDIDATE]: Term 1 election: Requested vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:37.652189 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b072ef29fc744eb9a9bf2726a91febb3" candidate_uuid: "7a1eb7ef7f2549668a98ce687988cdab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a111e3870dd24874898956eae1a9471d"
I20251211 21:02:37.652218 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b072ef29fc744eb9a9bf2726a91febb3" candidate_uuid: "7a1eb7ef7f2549668a98ce687988cdab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296"
I20251211 21:02:37.652292 31130 raft_consensus.cc:3060] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.652326 31281 raft_consensus.cc:3060] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.652702 31206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "679e7f1b63d44ac8b184e09ed666d19e" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab" is_pre_election: true
I20251211 21:02:37.652808 31206 raft_consensus.cc:2468] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 0.
I20251211 21:02:37.653129 31247 leader_election.cc:304] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.653285 31331 raft_consensus.cc:2804] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:37.653338 31331 raft_consensus.cc:493] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:37.653371 31331 raft_consensus.cc:3060] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.653381 31281 raft_consensus.cc:2468] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1eb7ef7f2549668a98ce687988cdab in term 1.
I20251211 21:02:37.653683 31170 leader_election.cc:304] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.653681 31130 raft_consensus.cc:2468] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1eb7ef7f2549668a98ce687988cdab in term 1.
I20251211 21:02:37.653863 31336 raft_consensus.cc:2804] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:37.654146 31336 raft_consensus.cc:697] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 LEADER]: Becoming Leader. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Running, Role: LEADER
I20251211 21:02:37.654255 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "679e7f1b63d44ac8b184e09ed666d19e" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a111e3870dd24874898956eae1a9471d" is_pre_election: true
I20251211 21:02:37.654227 31331 raft_consensus.cc:515] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.654338 31130 raft_consensus.cc:2468] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 0.
I20251211 21:02:37.654306 31336 consensus_queue.cc:237] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.654600 31331 leader_election.cc:290] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 election: Requested vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:37.654888 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "679e7f1b63d44ac8b184e09ed666d19e" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a111e3870dd24874898956eae1a9471d"
I20251211 21:02:37.654970 31206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "679e7f1b63d44ac8b184e09ed666d19e" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
I20251211 21:02:37.654984 31130 raft_consensus.cc:3060] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.655078 31206 raft_consensus.cc:3060] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.655836 31130 raft_consensus.cc:2468] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 1.
I20251211 21:02:37.655985 31206 raft_consensus.cc:2468] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 1.
I20251211 21:02:37.655970 31027 catalog_manager.cc:5654] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194). New cstate: current_term: 1 leader_uuid: "7a1eb7ef7f2549668a98ce687988cdab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:37.656142 31245 leader_election.cc:304] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a111e3870dd24874898956eae1a9471d, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.656665 31331 raft_consensus.cc:2804] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:37.656858 31331 raft_consensus.cc:697] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 1 LEADER]: Becoming Leader. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Running, Role: LEADER
I20251211 21:02:37.656986 31331 consensus_queue.cc:237] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.658425 31025 catalog_manager.cc:5654] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 reported cstate change: term changed from 0 to 1, leader changed from <none> to a734808ce5ad4def8838a47d6bd72296 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "a734808ce5ad4def8838a47d6bd72296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:37.658818 31332 raft_consensus.cc:493] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:37.658895 31332 raft_consensus.cc:515] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.659277 31332 leader_election.cc:290] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:37.662670 31206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7260db8fc77248b8a7f3c858a82d1ec9" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab" is_pre_election: true
I20251211 21:02:37.662670 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7260db8fc77248b8a7f3c858a82d1ec9" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296" is_pre_election: true
I20251211 21:02:37.662806 31206 raft_consensus.cc:2468] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 0.
I20251211 21:02:37.662837 31281 raft_consensus.cc:2468] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 0.
I20251211 21:02:37.663054 31094 leader_election.cc:304] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a111e3870dd24874898956eae1a9471d, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.663203 31332 raft_consensus.cc:2804] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:37.663261 31332 raft_consensus.cc:493] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:37.663302 31332 raft_consensus.cc:3060] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.664105 31332 raft_consensus.cc:515] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.664404 31332 leader_election.cc:290] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 election: Requested vote from peers 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:37.664713 31206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7260db8fc77248b8a7f3c858a82d1ec9" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
I20251211 21:02:37.664713 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7260db8fc77248b8a7f3c858a82d1ec9" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296"
I20251211 21:02:37.664822 31206 raft_consensus.cc:3060] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.664842 31281 raft_consensus.cc:3060] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.665576 31206 raft_consensus.cc:2468] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 1.
I20251211 21:02:37.665580 31281 raft_consensus.cc:2468] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 1.
I20251211 21:02:37.665822 31094 leader_election.cc:304] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a111e3870dd24874898956eae1a9471d, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.666028 31332 raft_consensus.cc:2804] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:37.666250 31332 raft_consensus.cc:697] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Becoming Leader. State: Replica: a111e3870dd24874898956eae1a9471d, State: Running, Role: LEADER
I20251211 21:02:37.666407 31332 consensus_queue.cc:237] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.667950 31025 catalog_manager.cc:5654] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d reported cstate change: term changed from 0 to 1, leader changed from <none> to a111e3870dd24874898956eae1a9471d (127.29.190.193). New cstate: current_term: 1 leader_uuid: "a111e3870dd24874898956eae1a9471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: UNKNOWN } } }
W20251211 21:02:37.695783 31157 tablet.cc:2378] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 21:02:37.700145 31331 raft_consensus.cc:493] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:37.700294 31331 raft_consensus.cc:515] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.700771 31331 leader_election.cc:290] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:37.701198 31206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2275bfbd88fd4564b2b6adec7dc84666" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab" is_pre_election: true
I20251211 21:02:37.701200 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2275bfbd88fd4564b2b6adec7dc84666" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a111e3870dd24874898956eae1a9471d" is_pre_election: true
I20251211 21:02:37.701337 31206 raft_consensus.cc:2468] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 0.
I20251211 21:02:37.701371 31130 raft_consensus.cc:2468] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 0.
I20251211 21:02:37.701612 31247 leader_election.cc:304] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.701633 31332 raft_consensus.cc:493] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:37.701726 31332 raft_consensus.cc:515] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.701777 31331 raft_consensus.cc:2804] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:37.701828 31331 raft_consensus.cc:493] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:37.701874 31331 raft_consensus.cc:3060] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.702069 31332 leader_election.cc:290] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:37.702386 31206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d9d6e6927de430c91237620fd4945c6" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab" is_pre_election: true
I20251211 21:02:37.702495 31206 raft_consensus.cc:2468] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 0.
I20251211 21:02:37.702689 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d9d6e6927de430c91237620fd4945c6" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296" is_pre_election: true
I20251211 21:02:37.702780 31096 leader_election.cc:304] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a111e3870dd24874898956eae1a9471d; no voters:
I20251211 21:02:37.702781 31281 raft_consensus.cc:2468] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 0.
I20251211 21:02:37.702939 31331 raft_consensus.cc:515] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.703162 31332 raft_consensus.cc:2804] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:37.703217 31332 raft_consensus.cc:493] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:37.703244 31331 leader_election.cc:290] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 election: Requested vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:37.703260 31332 raft_consensus.cc:3060] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.703650 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2275bfbd88fd4564b2b6adec7dc84666" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a111e3870dd24874898956eae1a9471d"
I20251211 21:02:37.703650 31206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2275bfbd88fd4564b2b6adec7dc84666" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
I20251211 21:02:37.703778 31206 raft_consensus.cc:3060] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.703776 31130 raft_consensus.cc:3060] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.704205 31332 raft_consensus.cc:515] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.704516 31332 leader_election.cc:290] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 election: Requested vote from peers 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:37.704640 31130 raft_consensus.cc:2468] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 1.
I20251211 21:02:37.704640 31206 raft_consensus.cc:2468] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 1.
I20251211 21:02:37.704797 31205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d9d6e6927de430c91237620fd4945c6" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
I20251211 21:02:37.704892 31205 raft_consensus.cc:3060] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.704931 31247 leader_election.cc:304] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.705073 31331 raft_consensus.cc:2804] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:37.705152 31331 raft_consensus.cc:697] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 1 LEADER]: Becoming Leader. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Running, Role: LEADER
I20251211 21:02:37.705268 31331 consensus_queue.cc:237] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.705649 31205 raft_consensus.cc:2468] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 1.
I20251211 21:02:37.705825 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d9d6e6927de430c91237620fd4945c6" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296"
I20251211 21:02:37.705909 31281 raft_consensus.cc:3060] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.705919 31096 leader_election.cc:304] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a111e3870dd24874898956eae1a9471d; no voters:
I20251211 21:02:37.706063 31332 raft_consensus.cc:2804] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:37.706179 31332 raft_consensus.cc:697] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Becoming Leader. State: Replica: a111e3870dd24874898956eae1a9471d, State: Running, Role: LEADER
I20251211 21:02:37.706315 31332 consensus_queue.cc:237] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.706674 31281 raft_consensus.cc:2468] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 1.
I20251211 21:02:37.706842 31025 catalog_manager.cc:5654] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 reported cstate change: term changed from 0 to 1, leader changed from <none> to a734808ce5ad4def8838a47d6bd72296 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "a734808ce5ad4def8838a47d6bd72296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:37.708115 31027 catalog_manager.cc:5654] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d reported cstate change: term changed from 0 to 1, leader changed from <none> to a111e3870dd24874898956eae1a9471d (127.29.190.193). New cstate: current_term: 1 leader_uuid: "a111e3870dd24874898956eae1a9471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:37.747180 31332 raft_consensus.cc:493] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:37.747361 31332 raft_consensus.cc:515] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.747829 31332 leader_election.cc:290] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991), 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:37.748256 31205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6304e9819242098a743ae33f8c2374" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab" is_pre_election: true
I20251211 21:02:37.748262 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6304e9819242098a743ae33f8c2374" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296" is_pre_election: true
I20251211 21:02:37.748385 31205 raft_consensus.cc:2468] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 0.
I20251211 21:02:37.748425 31281 raft_consensus.cc:2468] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 0.
I20251211 21:02:37.748667 31096 leader_election.cc:304] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a111e3870dd24874898956eae1a9471d, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.748907 31332 raft_consensus.cc:2804] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:37.748975 31332 raft_consensus.cc:493] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:37.749003 31332 raft_consensus.cc:3060] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.749815 31332 raft_consensus.cc:515] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.750126 31332 leader_election.cc:290] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 election: Requested vote from peers a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991), 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:37.750427 31205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6304e9819242098a743ae33f8c2374" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
I20251211 21:02:37.750516 31205 raft_consensus.cc:3060] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.750483 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6304e9819242098a743ae33f8c2374" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296"
I20251211 21:02:37.750598 31281 raft_consensus.cc:3060] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.751245 31281 raft_consensus.cc:2468] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 1.
I20251211 21:02:37.751252 31205 raft_consensus.cc:2468] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 1.
I20251211 21:02:37.751533 31094 leader_election.cc:304] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a111e3870dd24874898956eae1a9471d, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.751718 31332 raft_consensus.cc:2804] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:37.751809 31332 raft_consensus.cc:697] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Becoming Leader. State: Replica: a111e3870dd24874898956eae1a9471d, State: Running, Role: LEADER
I20251211 21:02:37.751937 31332 consensus_queue.cc:237] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } }
I20251211 21:02:37.753520 31331 raft_consensus.cc:493] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:37.753605 31331 raft_consensus.cc:515] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.753531 31027 catalog_manager.cc:5654] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d reported cstate change: term changed from 0 to 1, leader changed from <none> to a111e3870dd24874898956eae1a9471d (127.29.190.193). New cstate: current_term: 1 leader_uuid: "a111e3870dd24874898956eae1a9471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:37.753899 31331 leader_election.cc:290] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:37.754194 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13336733598e4be6a220fbb5dcbe9a4f" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a111e3870dd24874898956eae1a9471d" is_pre_election: true
I20251211 21:02:37.754228 31205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13336733598e4be6a220fbb5dcbe9a4f" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab" is_pre_election: true
I20251211 21:02:37.754292 31130 raft_consensus.cc:2468] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 0.
I20251211 21:02:37.754350 31205 raft_consensus.cc:2468] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 0.
I20251211 21:02:37.754505 31245 leader_election.cc:304] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a111e3870dd24874898956eae1a9471d, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.754705 31331 raft_consensus.cc:2804] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:37.754767 31331 raft_consensus.cc:493] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:37.754817 31331 raft_consensus.cc:3060] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.755596 31331 raft_consensus.cc:515] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.755928 31331 leader_election.cc:290] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 election: Requested vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801)
I20251211 21:02:37.756168 31205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13336733598e4be6a220fbb5dcbe9a4f" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
I20251211 21:02:37.756253 31205 raft_consensus.cc:3060] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.756902 31205 raft_consensus.cc:2468] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 1.
I20251211 21:02:37.757081 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13336733598e4be6a220fbb5dcbe9a4f" candidate_uuid: "a734808ce5ad4def8838a47d6bd72296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a111e3870dd24874898956eae1a9471d"
I20251211 21:02:37.757160 31130 raft_consensus.cc:3060] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.757153 31247 leader_election.cc:304] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:37.757328 31331 raft_consensus.cc:2804] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:37.757429 31331 raft_consensus.cc:697] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 1 LEADER]: Becoming Leader. State: Replica: a734808ce5ad4def8838a47d6bd72296, State: Running, Role: LEADER
I20251211 21:02:37.757543 31331 consensus_queue.cc:237] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.758060 31130 raft_consensus.cc:2468] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a734808ce5ad4def8838a47d6bd72296 in term 1.
I20251211 21:02:37.759003 31027 catalog_manager.cc:5654] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 reported cstate change: term changed from 0 to 1, leader changed from <none> to a734808ce5ad4def8838a47d6bd72296 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "a734808ce5ad4def8838a47d6bd72296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:37.885196 31332 raft_consensus.cc:493] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:37.885356 31332 raft_consensus.cc:515] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.885792 31332 leader_election.cc:290] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:37.886247 31205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8fdff0ae90d7434994682a337d6f1109" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab" is_pre_election: true
I20251211 21:02:37.886248 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8fdff0ae90d7434994682a337d6f1109" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296" is_pre_election: true
I20251211 21:02:37.886396 31205 raft_consensus.cc:2468] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 0.
I20251211 21:02:37.886435 31281 raft_consensus.cc:2468] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 0.
I20251211 21:02:37.886677 31096 leader_election.cc:304] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a111e3870dd24874898956eae1a9471d; no voters:
I20251211 21:02:37.886834 31332 raft_consensus.cc:2804] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:37.886885 31332 raft_consensus.cc:493] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:37.886917 31332 raft_consensus.cc:3060] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.887733 31332 raft_consensus.cc:515] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.888059 31332 leader_election.cc:290] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 election: Requested vote from peers 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:37.888394 31205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8fdff0ae90d7434994682a337d6f1109" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
I20251211 21:02:37.888394 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8fdff0ae90d7434994682a337d6f1109" candidate_uuid: "a111e3870dd24874898956eae1a9471d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a734808ce5ad4def8838a47d6bd72296"
I20251211 21:02:37.888532 31205 raft_consensus.cc:3060] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.888593 31281 raft_consensus.cc:3060] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:37.889624 31205 raft_consensus.cc:2468] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 1.
I20251211 21:02:37.889628 31281 raft_consensus.cc:2468] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a111e3870dd24874898956eae1a9471d in term 1.
I20251211 21:02:37.889894 31096 leader_election.cc:304] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a111e3870dd24874898956eae1a9471d; no voters:
I20251211 21:02:37.890038 31332 raft_consensus.cc:2804] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:37.890141 31332 raft_consensus.cc:697] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Becoming Leader. State: Replica: a111e3870dd24874898956eae1a9471d, State: Running, Role: LEADER
I20251211 21:02:37.890276 31332 consensus_queue.cc:237] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:37.891875 31027 catalog_manager.cc:5654] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d reported cstate change: term changed from 0 to 1, leader changed from <none> to a111e3870dd24874898956eae1a9471d (127.29.190.193). New cstate: current_term: 1 leader_uuid: "a111e3870dd24874898956eae1a9471d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:37.913250 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:37.915311 31374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:37.915320 31375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:37.915431 31377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:37.915508 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:37.915761 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:37.915818 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:37.915845 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486957915844 us; error 0 us; skew 500 ppm
I20251211 21:02:37.916755 30459 webserver.cc:492] Webserver started at http://127.29.190.196:45829/ using document root <none> and password file <none>
I20251211 21:02:37.916898 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:37.916945 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:37.917018 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:37.917392 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-3-root/instance:
uuid: "c358f09467394196bf531d58d860501e"
format_stamp: "Formatted at 2025-12-11 21:02:37 on dist-test-slave-xjj2"
I20251211 21:02:37.918787 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:02:37.919683 31382 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:37.919916 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:37.919974 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-3-root
uuid: "c358f09467394196bf531d58d860501e"
format_stamp: "Formatted at 2025-12-11 21:02:37 on dist-test-slave-xjj2"
I20251211 21:02:37.920029 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765486953797919-30459-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:37.928285 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:37.928717 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:37.929011 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:37.929473 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:37.929512 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:37.929545 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:37.929574 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:37.935065 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.196:45143
I20251211 21:02:37.935174 31445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.196:45143 every 8 connection(s)
I20251211 21:02:37.939433 31446 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41817
I20251211 21:02:37.939541 31446 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:37.939797 31446 heartbeater.cc:507] Master 127.29.190.254:41817 requested a full tablet report, sending...
I20251211 21:02:37.940394 31027 ts_manager.cc:194] Registered new tserver with Master: c358f09467394196bf531d58d860501e (127.29.190.196:45143)
I20251211 21:02:37.940898 31027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60042
I20251211 21:02:38.083636 31332 consensus_queue.cc:1048] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.086635 31332 consensus_queue.cc:1048] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.124827 31331 consensus_queue.cc:1048] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.127558 31363 consensus_queue.cc:1048] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.174276 31332 consensus_queue.cc:1048] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.177330 31458 consensus_queue.cc:1048] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.187330 31458 consensus_queue.cc:1048] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.190377 31367 consensus_queue.cc:1048] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.206471 31336 consensus_queue.cc:1048] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.209697 31463 consensus_queue.cc:1048] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.210619 31455 consensus_queue.cc:1048] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.213521 31455 consensus_queue.cc:1048] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.222132 31455 consensus_queue.cc:1048] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.224905 31363 consensus_queue.cc:1048] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.376722 31367 consensus_queue.cc:1048] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.379822 31458 consensus_queue.cc:1048] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:38.392436 31081 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:38.397785 31130 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7260db8fc77248b8a7f3c858a82d1ec9"
dest_uuid: "a111e3870dd24874898956eae1a9471d"
mode: GRACEFUL
new_leader_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
from {username='slave'} at 127.0.0.1:59642
I20251211 21:02:38.397971 31130 raft_consensus.cc:606] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Received request to transfer leadership to TS 7a1eb7ef7f2549668a98ce687988cdab
I20251211 21:02:38.398393 31081 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:02:38.398607 31081 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:38.514638 31332 raft_consensus.cc:993] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d: : Instructing follower 7a1eb7ef7f2549668a98ce687988cdab to start an election
I20251211 21:02:38.514762 31332 raft_consensus.cc:1081] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Signalling peer 7a1eb7ef7f2549668a98ce687988cdab to start an election
I20251211 21:02:38.515354 31205 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7260db8fc77248b8a7f3c858a82d1ec9"
dest_uuid: "7a1eb7ef7f2549668a98ce687988cdab"
from {username='slave'} at 127.0.0.1:53484
I20251211 21:02:38.515654 31205 raft_consensus.cc:493] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:02:38.515905 31205 raft_consensus.cc:3060] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:02:38.516801 31205 raft_consensus.cc:515] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:38.517223 31205 leader_election.cc:290] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [CANDIDATE]: Term 2 election: Requested vote from peers a111e3870dd24874898956eae1a9471d (127.29.190.193:41273), a734808ce5ad4def8838a47d6bd72296 (127.29.190.195:33991)
I20251211 21:02:38.517618 31130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7260db8fc77248b8a7f3c858a82d1ec9" candidate_uuid: "7a1eb7ef7f2549668a98ce687988cdab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a111e3870dd24874898956eae1a9471d"
I20251211 21:02:38.517665 31281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7260db8fc77248b8a7f3c858a82d1ec9" candidate_uuid: "7a1eb7ef7f2549668a98ce687988cdab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a734808ce5ad4def8838a47d6bd72296"
I20251211 21:02:38.517724 31130 raft_consensus.cc:3055] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:02:38.517764 31130 raft_consensus.cc:740] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a111e3870dd24874898956eae1a9471d, State: Running, Role: LEADER
I20251211 21:02:38.517791 31281 raft_consensus.cc:3060] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:02:38.517932 31130 consensus_queue.cc:260] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:38.518092 31130 raft_consensus.cc:3060] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:02:38.518678 31281 raft_consensus.cc:2468] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1eb7ef7f2549668a98ce687988cdab in term 2.
I20251211 21:02:38.518812 31130 raft_consensus.cc:2468] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1eb7ef7f2549668a98ce687988cdab in term 2.
I20251211 21:02:38.518956 31170 leader_election.cc:304] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1eb7ef7f2549668a98ce687988cdab, a734808ce5ad4def8838a47d6bd72296; no voters:
I20251211 21:02:38.519114 31336 raft_consensus.cc:2804] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:02:38.519202 31336 raft_consensus.cc:697] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 2 LEADER]: Becoming Leader. State: Replica: 7a1eb7ef7f2549668a98ce687988cdab, State: Running, Role: LEADER
I20251211 21:02:38.519340 31336 consensus_queue.cc:237] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } }
I20251211 21:02:38.520844 31027 catalog_manager.cc:5654] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab reported cstate change: term changed from 1 to 2, leader changed from a111e3870dd24874898956eae1a9471d (127.29.190.193) to 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194). New cstate: current_term: 2 leader_uuid: "7a1eb7ef7f2549668a98ce687988cdab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:38.941782 31446 heartbeater.cc:499] Master 127.29.190.254:41817 was elected leader, sending a full tablet report...
I20251211 21:02:39.033685 31281 raft_consensus.cc:1275] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 2 FOLLOWER]: Refusing update from remote peer 7a1eb7ef7f2549668a98ce687988cdab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:02:39.034116 31476 consensus_queue.cc:1048] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:02:39.036350 31130 raft_consensus.cc:1275] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 2 FOLLOWER]: Refusing update from remote peer 7a1eb7ef7f2549668a98ce687988cdab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:02:39.036921 31476 consensus_queue.cc:1048] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:02:40.398950 31081 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:40.399781 31081 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:02:40.399863 31081 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:42.400151 31081 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:42.400949 31081 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:02:42.401032 31081 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:43.406018 31205 consensus_queue.cc:237] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } attrs { replace: true } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } }
I20251211 21:02:43.407550 31130 raft_consensus.cc:1275] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 2 FOLLOWER]: Refusing update from remote peer 7a1eb7ef7f2549668a98ce687988cdab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251211 21:02:43.408000 31486 consensus_queue.cc:1048] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:02:43.408147 31281 raft_consensus.cc:1275] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 2 FOLLOWER]: Refusing update from remote peer 7a1eb7ef7f2549668a98ce687988cdab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251211 21:02:43.408684 31486 consensus_queue.cc:1048] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:02:43.409758 31336 raft_consensus.cc:2955] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } attrs { replace: true } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.410228 31130 raft_consensus.cc:2955] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } attrs { replace: true } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.412285 31027 catalog_manager.cc:5654] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab reported cstate change: config changed from index -1 to 3, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New cstate: current_term: 2 leader_uuid: "7a1eb7ef7f2549668a98ce687988cdab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:43.412508 31281 raft_consensus.cc:2955] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } attrs { replace: true } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
W20251211 21:02:43.412781 31169 consensus_peers.cc:597] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab -> Peer c358f09467394196bf531d58d860501e (127.29.190.196:45143): Couldn't send request to peer c358f09467394196bf531d58d860501e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7260db8fc77248b8a7f3c858a82d1ec9. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:02:43.416172 31281 consensus_queue.cc:237] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } }
I20251211 21:02:43.417634 31130 raft_consensus.cc:1275] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Refusing update from remote peer a734808ce5ad4def8838a47d6bd72296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:02:43.417977 31205 raft_consensus.cc:1275] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Refusing update from remote peer a734808ce5ad4def8838a47d6bd72296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:02:43.418069 31500 consensus_queue.cc:1048] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:02:43.418296 31499 consensus_queue.cc:1048] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:02:43.419806 31499 raft_consensus.cc:2955] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.420109 31130 raft_consensus.cc:2955] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
W20251211 21:02:43.422053 31244 consensus_peers.cc:597] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 -> Peer c358f09467394196bf531d58d860501e (127.29.190.196:45143): Couldn't send request to peer c358f09467394196bf531d58d860501e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13336733598e4be6a220fbb5dcbe9a4f. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:02:43.422163 31026 catalog_manager.cc:5654] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d reported cstate change: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "a734808ce5ad4def8838a47d6bd72296" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.422576 31205 raft_consensus.cc:2955] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.423122 31281 consensus_queue.cc:237] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } }
I20251211 21:02:43.424477 31205 raft_consensus.cc:1275] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Refusing update from remote peer a734808ce5ad4def8838a47d6bd72296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251211 21:02:43.424571 31244 consensus_peers.cc:597] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 -> Peer c358f09467394196bf531d58d860501e (127.29.190.196:45143): Couldn't send request to peer c358f09467394196bf531d58d860501e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2275bfbd88fd4564b2b6adec7dc84666. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:02:43.424589 31130 raft_consensus.cc:1275] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Refusing update from remote peer a734808ce5ad4def8838a47d6bd72296: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:02:43.424872 31331 consensus_queue.cc:1048] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:02:43.425031 31499 consensus_queue.cc:1048] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:02:43.426823 31331 raft_consensus.cc:2955] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.427505 31205 raft_consensus.cc:2955] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.427942 31130 raft_consensus.cc:2955] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.429782 31205 consensus_queue.cc:237] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } }
I20251211 21:02:43.429967 31026 catalog_manager.cc:5654] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 reported cstate change: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "a734808ce5ad4def8838a47d6bd72296" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:43.431303 31130 raft_consensus.cc:1275] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Refusing update from remote peer 7a1eb7ef7f2549668a98ce687988cdab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:02:43.431308 31281 raft_consensus.cc:1275] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Refusing update from remote peer 7a1eb7ef7f2549668a98ce687988cdab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251211 21:02:43.431542 31169 consensus_peers.cc:597] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab -> Peer c358f09467394196bf531d58d860501e (127.29.190.196:45143): Couldn't send request to peer c358f09467394196bf531d58d860501e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b072ef29fc744eb9a9bf2726a91febb3. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:02:43.431828 31486 consensus_queue.cc:1048] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:02:43.432145 31486 consensus_queue.cc:1048] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:02:43.433292 31492 raft_consensus.cc:2955] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.434890 31281 raft_consensus.cc:2955] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.435133 31025 catalog_manager.cc:5654] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab reported cstate change: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "7a1eb7ef7f2549668a98ce687988cdab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:43.435828 31130 raft_consensus.cc:2955] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c358f09467394196bf531d58d860501e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a111e3870dd24874898956eae1a9471d" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41273 } attrs { replace: true } } peers { permanent_uuid: "7a1eb7ef7f2549668a98ce687988cdab" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45801 } } peers { permanent_uuid: "a734808ce5ad4def8838a47d6bd72296" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 33991 } } peers { permanent_uuid: "c358f09467394196bf531d58d860501e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 45143 } attrs { promote: true } } }
I20251211 21:02:43.454872 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:02:43.458801 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:43.459012 30459 tablet_replica.cc:333] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d: stopping tablet replica
I20251211 21:02:43.459146 30459 raft_consensus.cc:2243] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.459324 30459 raft_consensus.cc:2272] T 679e7f1b63d44ac8b184e09ed666d19e P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.459856 30459 tablet_replica.cc:333] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d: stopping tablet replica
I20251211 21:02:43.459970 30459 raft_consensus.cc:2243] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.460146 30459 raft_consensus.cc:2272] T 1a6304e9819242098a743ae33f8c2374 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.460569 30459 tablet_replica.cc:333] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d: stopping tablet replica
I20251211 21:02:43.460668 30459 raft_consensus.cc:2243] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.460799 30459 raft_consensus.cc:2272] T 2275bfbd88fd4564b2b6adec7dc84666 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.461275 30459 tablet_replica.cc:333] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d: stopping tablet replica
I20251211 21:02:43.461364 30459 raft_consensus.cc:2243] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.461462 30459 raft_consensus.cc:2272] T 13336733598e4be6a220fbb5dcbe9a4f P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.461930 30459 tablet_replica.cc:333] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d: stopping tablet replica
I20251211 21:02:43.462085 30459 raft_consensus.cc:2243] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.462244 30459 raft_consensus.cc:2272] T 8fdff0ae90d7434994682a337d6f1109 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.462563 30459 tablet_replica.cc:333] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d: stopping tablet replica
I20251211 21:02:43.462654 30459 raft_consensus.cc:2243] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.462800 30459 raft_consensus.cc:2272] T 8d9d6e6927de430c91237620fd4945c6 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.463114 30459 tablet_replica.cc:333] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d: stopping tablet replica
I20251211 21:02:43.463197 30459 raft_consensus.cc:2243] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.463300 30459 raft_consensus.cc:2272] T 7260db8fc77248b8a7f3c858a82d1ec9 P a111e3870dd24874898956eae1a9471d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.463728 30459 tablet_replica.cc:333] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d: stopping tablet replica
I20251211 21:02:43.463815 30459 raft_consensus.cc:2243] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.463910 30459 raft_consensus.cc:2272] T b072ef29fc744eb9a9bf2726a91febb3 P a111e3870dd24874898956eae1a9471d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.467857 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:02:43.470316 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
W20251211 21:02:43.471267 31247 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20251211 21:02:43.472198 31247 consensus_peers.cc:597] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 -> Peer 7a1eb7ef7f2549668a98ce687988cdab (127.29.190.194:45801): Couldn't send request to peer 7a1eb7ef7f2549668a98ce687988cdab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20251211 21:02:43.473004 31075 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251211 21:02:43.473058 31075 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251211 21:02:43.474155 31075 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251211 21:02:43.474203 31075 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251211 21:02:43.475445 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:43.475622 30459 tablet_replica.cc:333] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab: stopping tablet replica
I20251211 21:02:43.475759 30459 raft_consensus.cc:2243] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.475865 30459 raft_consensus.cc:2272] T 1a6304e9819242098a743ae33f8c2374 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.476233 30459 tablet_replica.cc:333] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab: stopping tablet replica
I20251211 21:02:43.476322 30459 raft_consensus.cc:2243] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.476428 30459 raft_consensus.cc:2272] T 8d9d6e6927de430c91237620fd4945c6 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.476724 30459 tablet_replica.cc:333] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab: stopping tablet replica
I20251211 21:02:43.476811 30459 raft_consensus.cc:2243] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.476902 30459 raft_consensus.cc:2272] T 2275bfbd88fd4564b2b6adec7dc84666 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.477346 30459 tablet_replica.cc:333] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab: stopping tablet replica
I20251211 21:02:43.477432 30459 raft_consensus.cc:2243] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.477528 30459 raft_consensus.cc:2272] T 13336733598e4be6a220fbb5dcbe9a4f P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.477958 30459 tablet_replica.cc:333] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab: stopping tablet replica
I20251211 21:02:43.478083 30459 raft_consensus.cc:2243] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.478169 30459 raft_consensus.cc:2272] T 8fdff0ae90d7434994682a337d6f1109 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.478469 30459 tablet_replica.cc:333] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab: stopping tablet replica
I20251211 21:02:43.478554 30459 raft_consensus.cc:2243] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.478638 30459 raft_consensus.cc:2272] T 679e7f1b63d44ac8b184e09ed666d19e P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.478911 30459 tablet_replica.cc:333] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab: stopping tablet replica
I20251211 21:02:43.478986 30459 raft_consensus.cc:2243] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.479171 30459 raft_consensus.cc:2272] T b072ef29fc744eb9a9bf2726a91febb3 P 7a1eb7ef7f2549668a98ce687988cdab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.479751 30459 tablet_replica.cc:333] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab: stopping tablet replica
I20251211 21:02:43.479828 30459 raft_consensus.cc:2243] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.479991 30459 raft_consensus.cc:2272] T 7260db8fc77248b8a7f3c858a82d1ec9 P 7a1eb7ef7f2549668a98ce687988cdab [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.494266 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:02:43.497444 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
W20251211 21:02:43.499977 31075 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251211 21:02:43.500061 31075 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251211 21:02:43.501904 31075 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251211 21:02:43.501983 31075 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251211 21:02:43.502310 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:43.502488 30459 tablet_replica.cc:333] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296: stopping tablet replica
I20251211 21:02:43.502609 30459 raft_consensus.cc:2243] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.502730 30459 raft_consensus.cc:2272] T b072ef29fc744eb9a9bf2726a91febb3 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.503271 30459 tablet_replica.cc:333] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296: stopping tablet replica
I20251211 21:02:43.503367 30459 raft_consensus.cc:2243] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.503474 30459 raft_consensus.cc:2272] T 7260db8fc77248b8a7f3c858a82d1ec9 P a734808ce5ad4def8838a47d6bd72296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.503955 30459 tablet_replica.cc:333] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296: stopping tablet replica
I20251211 21:02:43.504045 30459 raft_consensus.cc:2243] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.504217 30459 raft_consensus.cc:2272] T 2275bfbd88fd4564b2b6adec7dc84666 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.504649 30459 tablet_replica.cc:333] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296: stopping tablet replica
I20251211 21:02:43.504745 30459 raft_consensus.cc:2243] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.504828 30459 raft_consensus.cc:2272] T 1a6304e9819242098a743ae33f8c2374 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.505115 30459 tablet_replica.cc:333] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296: stopping tablet replica
I20251211 21:02:43.505193 30459 raft_consensus.cc:2243] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.505352 30459 raft_consensus.cc:2272] T 13336733598e4be6a220fbb5dcbe9a4f P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.505867 30459 tablet_replica.cc:333] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296: stopping tablet replica
I20251211 21:02:43.505956 30459 raft_consensus.cc:2243] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.506048 30459 raft_consensus.cc:2272] T 8fdff0ae90d7434994682a337d6f1109 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.506330 30459 tablet_replica.cc:333] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296: stopping tablet replica
I20251211 21:02:43.506422 30459 raft_consensus.cc:2243] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.506567 30459 raft_consensus.cc:2272] T 679e7f1b63d44ac8b184e09ed666d19e P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.506856 30459 tablet_replica.cc:333] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296: stopping tablet replica
I20251211 21:02:43.506929 30459 raft_consensus.cc:2243] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:43.507015 30459 raft_consensus.cc:2272] T 8d9d6e6927de430c91237620fd4945c6 P a734808ce5ad4def8838a47d6bd72296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.510521 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:02:43.512913 30459 tablet_server.cc:178] TabletServer@127.29.190.196:0 shutting down...
I20251211 21:02:43.516674 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:43.529553 30459 tablet_server.cc:195] TabletServer@127.29.190.196:0 shutdown complete.
I20251211 21:02:43.531324 30459 master.cc:561] Master@127.29.190.254:41817 shutting down...
I20251211 21:02:43.534888 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:43.535050 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:43.535113 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P f5abeebabe7d4cdda2700d577343a6e7: stopping tablet replica
I20251211 21:02:43.547868 30459 master.cc:583] Master@127.29.190.254:41817 shutdown complete.
[ OK ] AutoRebalancerTest.AutoRebalancingTurnOffAndOn (7192 ms)
[ RUN ] AutoRebalancerTest.NextLeaderResumesAutoRebalancing
I20251211 21:02:43.557122 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:45505,127.29.190.253:38507,127.29.190.252:33295
I20251211 21:02:43.557534 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:43.559523 31515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.559571 31514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.559636 31517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:43.559751 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:43.559960 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:43.560000 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:43.560015 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486963560015 us; error 0 us; skew 500 ppm
I20251211 21:02:43.560873 30459 webserver.cc:492] Webserver started at http://127.29.190.254:44977/ using document root <none> and password file <none>
I20251211 21:02:43.560999 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:43.561039 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:43.561093 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:43.561440 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "3fc072197925441bbc0ae3c8b3c1747b"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.562738 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.563521 31522 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.563757 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.563817 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "3fc072197925441bbc0ae3c8b3c1747b"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.563882 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:43.580125 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:43.580514 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:43.584395 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:45505
I20251211 21:02:43.585539 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:02:43.589133 31574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:45505 every 8 connection(s)
I20251211 21:02:43.589798 31575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20251211 21:02:43.590109 31580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:43.590286 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:43.590312 31578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.590466 31577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:43.590704 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:43.590747 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:43.590761 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486963590761 us; error 0 us; skew 500 ppm
I20251211 21:02:43.591265 31575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:43.591542 30459 webserver.cc:492] Webserver started at http://127.29.190.253:38883/ using document root <none> and password file <none>
I20251211 21:02:43.591709 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:43.591759 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:43.591818 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:43.592137 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root/instance:
uuid: "37d6df32c8984cbe858d80036d1e1e11"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.593479 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.594427 31587 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.594691 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.594761 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root
uuid: "37d6df32c8984cbe858d80036d1e1e11"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.594830 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:43.596922 31575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } has no permanent_uuid. Determining permanent_uuid...
W20251211 21:02:43.598119 31575 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.190.253:38507: Network error: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111)
I20251211 21:02:43.600405 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:43.600699 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:43.604264 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.253:38507
I20251211 21:02:43.604282 31640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.253:38507 every 8 connection(s)
I20251211 21:02:43.604924 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:02:43.605031 31641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20251211 21:02:43.606367 31646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.606352 31643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.606451 31644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:43.606590 31641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:43.606690 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:43.606848 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:43.606890 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:43.606909 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486963606908 us; error 0 us; skew 500 ppm
I20251211 21:02:43.607795 30459 webserver.cc:492] Webserver started at http://127.29.190.252:39339/ using document root <none> and password file <none>
I20251211 21:02:43.607944 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:43.607991 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:43.608054 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:43.608408 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root/instance:
uuid: "17b299aad0624bcfa3896aee89ce5a17"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.610042 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:02:43.610894 31641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:43.611109 31652 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.611383 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.611457 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root
uuid: "17b299aad0624bcfa3896aee89ce5a17"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.611529 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:43.614696 31641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } has no permanent_uuid. Determining permanent_uuid...
W20251211 21:02:43.615834 31641 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.190.252:33295: Network error: Client connection negotiation failed: client connection to 127.29.190.252:33295: connect: Connection refused (error 111)
I20251211 21:02:43.623440 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:43.623857 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:43.627926 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.252:33295
I20251211 21:02:43.627974 31706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.252:33295 every 8 connection(s)
I20251211 21:02:43.628480 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:02:43.628872 31707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:43.629956 31707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:43.633738 31707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:43.636965 31707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:43.641273 31707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17: Bootstrap starting.
I20251211 21:02:43.642181 31707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:43.643235 31707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17: No bootstrap required, opened a new log
I20251211 21:02:43.643685 31707 raft_consensus.cc:359] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.643780 31707 raft_consensus.cc:385] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:43.643807 31707 raft_consensus.cc:740] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b299aad0624bcfa3896aee89ce5a17, State: Initialized, Role: FOLLOWER
I20251211 21:02:43.643915 31707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.644191 31712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.644295 31712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:43.644315 31707 sys_catalog.cc:565] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [sys.catalog]: configured and running, proceeding with master startup.
W20251211 21:02:43.646162 31723 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 21:02:43.646226 31723 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 21:02:43.653272 31575 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } attempt: 1
I20251211 21:02:43.657267 31575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } has no permanent_uuid. Determining permanent_uuid...
I20251211 21:02:43.661602 31575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: Bootstrap starting.
I20251211 21:02:43.662550 31575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:43.663655 31575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: No bootstrap required, opened a new log
I20251211 21:02:43.664069 31575 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.664166 31575 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:43.664199 31575 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc072197925441bbc0ae3c8b3c1747b, State: Initialized, Role: FOLLOWER
I20251211 21:02:43.664323 31575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.664628 31725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.664721 31725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:43.664764 31575 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:02:43.666285 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20251211 21:02:43.666831 31736 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 21:02:43.666893 31736 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 21:02:43.667965 31641 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } attempt: 1
I20251211 21:02:43.672232 31641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11: Bootstrap starting.
I20251211 21:02:43.673153 31641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:43.674212 31641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11: No bootstrap required, opened a new log
I20251211 21:02:43.674613 31641 raft_consensus.cc:359] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.674701 31641 raft_consensus.cc:385] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:43.674729 31641 raft_consensus.cc:740] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37d6df32c8984cbe858d80036d1e1e11, State: Initialized, Role: FOLLOWER
I20251211 21:02:43.674834 31641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.675084 31738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.675170 31738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:43.675210 31641 sys_catalog.cc:565] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:02:43.676723 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20251211 21:02:43.677203 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:43.677294 31749 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 21:02:43.677346 31749 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20251211 21:02:43.678897 31750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.678989 31753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.678977 31751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:43.679134 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:43.679384 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:43.679435 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:43.679458 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486963679457 us; error 0 us; skew 500 ppm
I20251211 21:02:43.680336 30459 webserver.cc:492] Webserver started at http://127.29.190.193:37027/ using document root <none> and password file <none>
I20251211 21:02:43.680487 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:43.680534 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:43.680605 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:43.680951 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "00d3b3db21c448d3a0e1124d9429a251"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.682266 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.683068 31758 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.683279 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.683336 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "00d3b3db21c448d3a0e1124d9429a251"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.683398 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:43.691733 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:43.692158 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:43.692440 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:43.692920 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:43.692960 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.692991 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:43.693006 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.697602 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:43727
I20251211 21:02:43.697641 31821 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:43727 every 8 connection(s)
I20251211 21:02:43.698974 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:43.701040 31832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.701699 31830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:43.701943 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:43.702116 31829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:43.702395 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:43.702445 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:43.702477 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486963702476 us; error 0 us; skew 500 ppm
I20251211 21:02:43.703352 31824 heartbeater.cc:344] Connected to a master server at 127.29.190.253:38507
I20251211 21:02:43.703349 30459 webserver.cc:492] Webserver started at http://127.29.190.194:33939/ using document root <none> and password file <none>
I20251211 21:02:43.703472 31824 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.703557 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:43.703637 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:43.703711 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:43.703768 31822 heartbeater.cc:344] Connected to a master server at 127.29.190.252:33295
I20251211 21:02:43.703742 31824 heartbeater.cc:507] Master 127.29.190.253:38507 requested a full tablet report, sending...
I20251211 21:02:43.703840 31822 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.703863 31823 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45505
I20251211 21:02:43.703914 31823 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.704030 31822 heartbeater.cc:507] Master 127.29.190.252:33295 requested a full tablet report, sending...
I20251211 21:02:43.704041 31823 heartbeater.cc:507] Master 127.29.190.254:45505 requested a full tablet report, sending...
I20251211 21:02:43.704221 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "44b152c7c5cf4d5baa3a9cc19ee814af"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.704450 31605 ts_manager.cc:194] Registered new tserver with Master: 00d3b3db21c448d3a0e1124d9429a251 (127.29.190.193:43727)
I20251211 21:02:43.704656 31539 ts_manager.cc:194] Registered new tserver with Master: 00d3b3db21c448d3a0e1124d9429a251 (127.29.190.193:43727)
I20251211 21:02:43.704936 31671 ts_manager.cc:194] Registered new tserver with Master: 00d3b3db21c448d3a0e1124d9429a251 (127.29.190.193:43727)
I20251211 21:02:43.705844 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:43.706688 31837 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.706933 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:43.706993 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "44b152c7c5cf4d5baa3a9cc19ee814af"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.707046 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:43.712090 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:43.712532 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:43.712793 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:43.713258 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:43.713299 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.713339 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:43.713366 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.718168 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:41689
I20251211 21:02:43.718200 31900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:41689 every 8 connection(s)
I20251211 21:02:43.719172 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:43.721804 31911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.722062 31909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:43.722610 31908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:43.722975 30459 server_base.cc:1047] running on GCE node
I20251211 21:02:43.723204 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:43.723269 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:43.723301 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486963723300 us; error 0 us; skew 500 ppm
I20251211 21:02:43.724099 31901 heartbeater.cc:344] Connected to a master server at 127.29.190.252:33295
I20251211 21:02:43.724146 31902 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45505
I20251211 21:02:43.724251 31902 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.724316 30459 webserver.cc:492] Webserver started at http://127.29.190.195:43745/ using document root <none> and password file <none>
I20251211 21:02:43.724445 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:43.724499 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:43.724450 31902 heartbeater.cc:507] Master 127.29.190.254:45505 requested a full tablet report, sending...
I20251211 21:02:43.724584 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:43.724699 31901 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.724936 31903 heartbeater.cc:344] Connected to a master server at 127.29.190.253:38507
I20251211 21:02:43.724951 31901 heartbeater.cc:507] Master 127.29.190.252:33295 requested a full tablet report, sending...
I20251211 21:02:43.725029 31903 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.725013 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "2bca7397227441778ecf0d1ec4fb68dc"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.725214 31903 heartbeater.cc:507] Master 127.29.190.253:38507 requested a full tablet report, sending...
I20251211 21:02:43.725577 31671 ts_manager.cc:194] Registered new tserver with Master: 44b152c7c5cf4d5baa3a9cc19ee814af (127.29.190.194:41689)
I20251211 21:02:43.725584 31539 ts_manager.cc:194] Registered new tserver with Master: 44b152c7c5cf4d5baa3a9cc19ee814af (127.29.190.194:41689)
I20251211 21:02:43.725714 31605 ts_manager.cc:194] Registered new tserver with Master: 44b152c7c5cf4d5baa3a9cc19ee814af (127.29.190.194:41689)
I20251211 21:02:43.726744 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.727700 31916 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.727919 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:43.727977 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "2bca7397227441778ecf0d1ec4fb68dc"
format_stamp: "Formatted at 2025-12-11 21:02:43 on dist-test-slave-xjj2"
I20251211 21:02:43.728037 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:43.740752 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:43.741212 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:43.741513 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:43.741995 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:43.742038 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.742080 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:43.742106 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:43.746768 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:35833
I20251211 21:02:43.746841 31979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:35833 every 8 connection(s)
I20251211 21:02:43.751770 31981 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45505
I20251211 21:02:43.751889 31981 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.752101 31982 heartbeater.cc:344] Connected to a master server at 127.29.190.253:38507
I20251211 21:02:43.752138 31981 heartbeater.cc:507] Master 127.29.190.254:45505 requested a full tablet report, sending...
I20251211 21:02:43.752168 31980 heartbeater.cc:344] Connected to a master server at 127.29.190.252:33295
I20251211 21:02:43.752188 31982 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.752305 31980 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:43.752513 31982 heartbeater.cc:507] Master 127.29.190.253:38507 requested a full tablet report, sending...
I20251211 21:02:43.752530 31980 heartbeater.cc:507] Master 127.29.190.252:33295 requested a full tablet report, sending...
I20251211 21:02:43.752765 31539 ts_manager.cc:194] Registered new tserver with Master: 2bca7397227441778ecf0d1ec4fb68dc (127.29.190.195:35833)
I20251211 21:02:43.753096 31605 ts_manager.cc:194] Registered new tserver with Master: 2bca7397227441778ecf0d1ec4fb68dc (127.29.190.195:35833)
I20251211 21:02:43.753096 31671 ts_manager.cc:194] Registered new tserver with Master: 2bca7397227441778ecf0d1ec4fb68dc (127.29.190.195:35833)
I20251211 21:02:43.753243 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00596066s
I20251211 21:02:43.883392 31738 raft_consensus.cc:493] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:43.883556 31738 raft_consensus.cc:515] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.884011 31738 leader_election.cc:290] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fc072197925441bbc0ae3c8b3c1747b (127.29.190.254:45505), 17b299aad0624bcfa3896aee89ce5a17 (127.29.190.252:33295)
I20251211 21:02:43.884483 31549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37d6df32c8984cbe858d80036d1e1e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc072197925441bbc0ae3c8b3c1747b" is_pre_election: true
I20251211 21:02:43.884519 31681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37d6df32c8984cbe858d80036d1e1e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b299aad0624bcfa3896aee89ce5a17" is_pre_election: true
I20251211 21:02:43.884621 31549 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37d6df32c8984cbe858d80036d1e1e11 in term 0.
I20251211 21:02:43.884660 31681 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37d6df32c8984cbe858d80036d1e1e11 in term 0.
I20251211 21:02:43.884917 31588 leader_election.cc:304] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37d6df32c8984cbe858d80036d1e1e11, 3fc072197925441bbc0ae3c8b3c1747b; no voters:
I20251211 21:02:43.885067 31738 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:43.885119 31738 raft_consensus.cc:493] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:43.885146 31738 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:43.886001 31738 raft_consensus.cc:515] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.886303 31738 leader_election.cc:290] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [CANDIDATE]: Term 1 election: Requested vote from peers 3fc072197925441bbc0ae3c8b3c1747b (127.29.190.254:45505), 17b299aad0624bcfa3896aee89ce5a17 (127.29.190.252:33295)
I20251211 21:02:43.886619 31549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37d6df32c8984cbe858d80036d1e1e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc072197925441bbc0ae3c8b3c1747b"
I20251211 21:02:43.886634 31681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37d6df32c8984cbe858d80036d1e1e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b299aad0624bcfa3896aee89ce5a17"
I20251211 21:02:43.886719 31549 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:43.886736 31681 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:43.887512 31681 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37d6df32c8984cbe858d80036d1e1e11 in term 1.
I20251211 21:02:43.887547 31549 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37d6df32c8984cbe858d80036d1e1e11 in term 1.
I20251211 21:02:43.887768 31588 leader_election.cc:304] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b299aad0624bcfa3896aee89ce5a17, 37d6df32c8984cbe858d80036d1e1e11; no voters:
I20251211 21:02:43.887912 31738 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:43.888103 31738 raft_consensus.cc:697] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 1 LEADER]: Becoming Leader. State: Replica: 37d6df32c8984cbe858d80036d1e1e11, State: Running, Role: LEADER
I20251211 21:02:43.888236 31738 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:43.888860 31988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37d6df32c8984cbe858d80036d1e1e11. Latest consensus state: current_term: 1 leader_uuid: "37d6df32c8984cbe858d80036d1e1e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.888962 31988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:43.889226 31990 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:02:43.889925 31990 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:02:43.891621 31681 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 1 FOLLOWER]: Refusing update from remote peer 37d6df32c8984cbe858d80036d1e1e11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:02:43.891598 31549 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 1 FOLLOWER]: Refusing update from remote peer 37d6df32c8984cbe858d80036d1e1e11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:02:43.892010 31738 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:43.892172 31988 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:43.893332 31725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37d6df32c8984cbe858d80036d1e1e11. Latest consensus state: current_term: 1 leader_uuid: "37d6df32c8984cbe858d80036d1e1e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.893333 31712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37d6df32c8984cbe858d80036d1e1e11. Latest consensus state: current_term: 1 leader_uuid: "37d6df32c8984cbe858d80036d1e1e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.893469 31725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:43.893481 31712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:43.894731 31988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "37d6df32c8984cbe858d80036d1e1e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.894832 31988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:43.894928 31988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "37d6df32c8984cbe858d80036d1e1e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.894958 31990 catalog_manager.cc:1357] Generated new cluster ID: 6fced851e734435687104d75f70cf9a5
I20251211 21:02:43.895026 31990 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:02:43.895022 31725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "37d6df32c8984cbe858d80036d1e1e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.895140 31725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:43.895011 31988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:43.896235 31712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "37d6df32c8984cbe858d80036d1e1e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:43.896327 31712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 21:02:43.901540 31990 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:02:43.902086 31990 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:02:43.907830 31990 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11: Generated new TSK 0
I20251211 21:02:43.908075 31990 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:02:44.647002 31723 catalog_manager.cc:1269] Loaded cluster ID: 6fced851e734435687104d75f70cf9a5
I20251211 21:02:44.647095 31723 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17: loading cluster ID for follower catalog manager: success
I20251211 21:02:44.648365 31723 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17: acquiring CA information for follower catalog manager: success
I20251211 21:02:44.648918 31723 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251211 21:02:44.667718 31736 catalog_manager.cc:1269] Loaded cluster ID: 6fced851e734435687104d75f70cf9a5
I20251211 21:02:44.667802 31736 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: loading cluster ID for follower catalog manager: success
I20251211 21:02:44.668965 31736 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: acquiring CA information for follower catalog manager: success
I20251211 21:02:44.669521 31736 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251211 21:02:44.706764 31605 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47216
I20251211 21:02:44.727658 31605 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47230
I20251211 21:02:44.754734 31605 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47240
I20251211 21:02:45.676880 31748 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:45.707571 31824 heartbeater.cc:499] Master 127.29.190.253:38507 was elected leader, sending a full tablet report...
I20251211 21:02:45.728500 31903 heartbeater.cc:499] Master 127.29.190.253:38507 was elected leader, sending a full tablet report...
I20251211 21:02:45.755561 31982 heartbeater.cc:499] Master 127.29.190.253:38507 was elected leader, sending a full tablet report...
I20251211 21:02:46.006942 30459 test_util.cc:276] Using random seed: 2004280473
I20251211 21:02:46.015996 31605 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47254:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\252\252\252*\004\001\000TUUU""\004\001\000\252\252\252*\004\001\000TUUU"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251211 21:02:46.029542 31865 tablet_service.cc:1505] Processing CreateTablet for tablet 1f6fd5dc17cc488291f1d98846812751 (DEFAULT_TABLE table=test-workload [id=4eb4d21059394526a8f58d8901b933b6]), partition=RANGE (key) PARTITION VALUES < 715827882
I20251211 21:02:46.029906 31865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6fd5dc17cc488291f1d98846812751. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:46.030812 31786 tablet_service.cc:1505] Processing CreateTablet for tablet 2455b975480347c69a1bcb80055bdf23 (DEFAULT_TABLE table=test-workload [id=4eb4d21059394526a8f58d8901b933b6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20251211 21:02:46.030930 31944 tablet_service.cc:1505] Processing CreateTablet for tablet d7c7e8da83c54142a86d129274664262 (DEFAULT_TABLE table=test-workload [id=4eb4d21059394526a8f58d8901b933b6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20251211 21:02:46.031054 31786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2455b975480347c69a1bcb80055bdf23. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:46.031162 31944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c7e8da83c54142a86d129274664262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:46.032296 32028 tablet_bootstrap.cc:492] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af: Bootstrap starting.
I20251211 21:02:46.033299 32028 tablet_bootstrap.cc:654] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:46.033300 32030 tablet_bootstrap.cc:492] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc: Bootstrap starting.
I20251211 21:02:46.033573 32029 tablet_bootstrap.cc:492] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251: Bootstrap starting.
I20251211 21:02:46.034253 32030 tablet_bootstrap.cc:654] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:46.034467 32029 tablet_bootstrap.cc:654] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:46.034610 32028 tablet_bootstrap.cc:492] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af: No bootstrap required, opened a new log
I20251211 21:02:46.034693 32028 ts_tablet_manager.cc:1403] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:46.035097 32028 raft_consensus.cc:359] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b152c7c5cf4d5baa3a9cc19ee814af" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41689 } }
I20251211 21:02:46.035209 32028 raft_consensus.cc:385] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:46.035248 32028 raft_consensus.cc:740] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b152c7c5cf4d5baa3a9cc19ee814af, State: Initialized, Role: FOLLOWER
I20251211 21:02:46.035249 32030 tablet_bootstrap.cc:492] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc: No bootstrap required, opened a new log
I20251211 21:02:46.035349 32030 ts_tablet_manager.cc:1403] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:46.035370 32028 consensus_queue.cc:260] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b152c7c5cf4d5baa3a9cc19ee814af" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41689 } }
I20251211 21:02:46.035442 32028 raft_consensus.cc:399] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:46.035480 32028 raft_consensus.cc:493] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:46.035562 32028 raft_consensus.cc:3060] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:46.035782 32030 raft_consensus.cc:359] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bca7397227441778ecf0d1ec4fb68dc" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 35833 } }
I20251211 21:02:46.035867 32030 raft_consensus.cc:385] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:46.035902 32030 raft_consensus.cc:740] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bca7397227441778ecf0d1ec4fb68dc, State: Initialized, Role: FOLLOWER
I20251211 21:02:46.036000 32030 consensus_queue.cc:260] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bca7397227441778ecf0d1ec4fb68dc" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 35833 } }
I20251211 21:02:46.036078 32030 raft_consensus.cc:399] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:46.036154 32030 raft_consensus.cc:493] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:46.036218 32030 raft_consensus.cc:3060] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:46.036497 32028 raft_consensus.cc:515] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b152c7c5cf4d5baa3a9cc19ee814af" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41689 } }
I20251211 21:02:46.036626 32028 leader_election.cc:304] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44b152c7c5cf4d5baa3a9cc19ee814af; no voters:
I20251211 21:02:46.036809 32028 leader_election.cc:290] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:46.036906 32034 raft_consensus.cc:2804] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:46.037075 32030 raft_consensus.cc:515] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bca7397227441778ecf0d1ec4fb68dc" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 35833 } }
I20251211 21:02:46.037124 32028 ts_tablet_manager.cc:1434] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251211 21:02:46.037369 32030 leader_election.cc:304] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bca7397227441778ecf0d1ec4fb68dc; no voters:
I20251211 21:02:46.035446 32029 tablet_bootstrap.cc:492] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251: No bootstrap required, opened a new log
I20251211 21:02:46.037559 32030 leader_election.cc:290] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:46.037577 32029 ts_tablet_manager.cc:1403] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:02:46.037670 32037 raft_consensus.cc:2804] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:46.037842 32037 raft_consensus.cc:697] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 1 LEADER]: Becoming Leader. State: Replica: 2bca7397227441778ecf0d1ec4fb68dc, State: Running, Role: LEADER
I20251211 21:02:46.037873 32030 ts_tablet_manager.cc:1434] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:46.037956 32037 consensus_queue.cc:237] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bca7397227441778ecf0d1ec4fb68dc" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 35833 } }
I20251211 21:02:46.038031 32029 raft_consensus.cc:359] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00d3b3db21c448d3a0e1124d9429a251" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 43727 } }
I20251211 21:02:46.038151 32029 raft_consensus.cc:385] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:46.038192 32029 raft_consensus.cc:740] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00d3b3db21c448d3a0e1124d9429a251, State: Initialized, Role: FOLLOWER
I20251211 21:02:46.038297 32029 consensus_queue.cc:260] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00d3b3db21c448d3a0e1124d9429a251" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 43727 } }
I20251211 21:02:46.038380 32029 raft_consensus.cc:399] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:46.037166 32034 raft_consensus.cc:697] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 1 LEADER]: Becoming Leader. State: Replica: 44b152c7c5cf4d5baa3a9cc19ee814af, State: Running, Role: LEADER
I20251211 21:02:46.038466 32029 raft_consensus.cc:493] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:46.038552 32029 raft_consensus.cc:3060] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:46.038560 32034 consensus_queue.cc:237] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b152c7c5cf4d5baa3a9cc19ee814af" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41689 } }
I20251211 21:02:46.039867 32029 raft_consensus.cc:515] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00d3b3db21c448d3a0e1124d9429a251" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 43727 } }
I20251211 21:02:46.040032 32029 leader_election.cc:304] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00d3b3db21c448d3a0e1124d9429a251; no voters:
I20251211 21:02:46.040225 31605 catalog_manager.cc:5654] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bca7397227441778ecf0d1ec4fb68dc (127.29.190.195). New cstate: current_term: 1 leader_uuid: "2bca7397227441778ecf0d1ec4fb68dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bca7397227441778ecf0d1ec4fb68dc" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 35833 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:46.040313 31604 catalog_manager.cc:5654] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af reported cstate change: term changed from 0 to 1, leader changed from <none> to 44b152c7c5cf4d5baa3a9cc19ee814af (127.29.190.194). New cstate: current_term: 1 leader_uuid: "44b152c7c5cf4d5baa3a9cc19ee814af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b152c7c5cf4d5baa3a9cc19ee814af" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41689 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:46.040293 32029 leader_election.cc:290] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:46.040699 32029 ts_tablet_manager.cc:1434] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:02:46.042289 32042 raft_consensus.cc:2804] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:46.042507 32042 raft_consensus.cc:697] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 1 LEADER]: Becoming Leader. State: Replica: 00d3b3db21c448d3a0e1124d9429a251, State: Running, Role: LEADER
I20251211 21:02:46.042670 32042 consensus_queue.cc:237] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00d3b3db21c448d3a0e1124d9429a251" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 43727 } }
I20251211 21:02:46.049539 31604 catalog_manager.cc:5654] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00d3b3db21c448d3a0e1124d9429a251 (127.29.190.193). New cstate: current_term: 1 leader_uuid: "00d3b3db21c448d3a0e1124d9429a251" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00d3b3db21c448d3a0e1124d9429a251" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 43727 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:46.054057 30459 master.cc:561] Master@127.29.190.253:38507 shutting down...
I20251211 21:02:46.056587 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:46.056775 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:46.056826 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 37d6df32c8984cbe858d80036d1e1e11: stopping tablet replica
I20251211 21:02:46.070201 30459 master.cc:583] Master@127.29.190.253:38507 shutdown complete.
W20251211 21:02:47.046175 31903 heartbeater.cc:646] Failed to heartbeat to 127.29.190.253:38507 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111)
I20251211 21:02:47.553088 32052 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37d6df32c8984cbe858d80036d1e1e11)
I20251211 21:02:47.553220 32053 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37d6df32c8984cbe858d80036d1e1e11)
I20251211 21:02:47.553282 32052 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:47.553323 32053 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:47.553768 32052 leader_election.cc:290] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507), 17b299aad0624bcfa3896aee89ce5a17 (127.29.190.252:33295)
I20251211 21:02:47.554049 32053 leader_election.cc:290] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc072197925441bbc0ae3c8b3c1747b (127.29.190.254:45505), 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507)
I20251211 21:02:47.554150 31681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3fc072197925441bbc0ae3c8b3c1747b" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "17b299aad0624bcfa3896aee89ce5a17" is_pre_election: true
I20251211 21:02:47.554255 31549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17b299aad0624bcfa3896aee89ce5a17" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "3fc072197925441bbc0ae3c8b3c1747b" is_pre_election: true
I20251211 21:02:47.554289 31681 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc072197925441bbc0ae3c8b3c1747b in term 1.
I20251211 21:02:47.554356 31549 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b299aad0624bcfa3896aee89ce5a17 in term 1.
I20251211 21:02:47.554653 31523 leader_election.cc:304] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b299aad0624bcfa3896aee89ce5a17, 3fc072197925441bbc0ae3c8b3c1747b; no voters:
I20251211 21:02:47.554750 31654 leader_election.cc:304] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b299aad0624bcfa3896aee89ce5a17, 3fc072197925441bbc0ae3c8b3c1747b; no voters:
I20251211 21:02:47.554872 32052 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 21:02:47.554909 32053 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 21:02:47.554975 32053 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37d6df32c8984cbe858d80036d1e1e11)
I20251211 21:02:47.554920 32052 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37d6df32c8984cbe858d80036d1e1e11)
I20251211 21:02:47.555019 32053 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 1 FOLLOWER]: Advancing to term 2
W20251211 21:02:47.555274 31655 leader_election.cc:336] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507): Network error: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111)
W20251211 21:02:47.555478 31524 leader_election.cc:336] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507): Network error: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111)
I20251211 21:02:47.555588 32052 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:02:47.556155 32053 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:47.556440 32052 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:47.556496 32053 leader_election.cc:290] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [CANDIDATE]: Term 2 election: Requested vote from peers 3fc072197925441bbc0ae3c8b3c1747b (127.29.190.254:45505), 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507)
I20251211 21:02:47.556775 31549 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17b299aad0624bcfa3896aee89ce5a17" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "3fc072197925441bbc0ae3c8b3c1747b"
I20251211 21:02:47.556799 32052 leader_election.cc:290] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 2 election: Requested vote from peers 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507), 17b299aad0624bcfa3896aee89ce5a17 (127.29.190.252:33295)
I20251211 21:02:47.556967 31549 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17b299aad0624bcfa3896aee89ce5a17 in current term 2: Already voted for candidate 3fc072197925441bbc0ae3c8b3c1747b in this term.
I20251211 21:02:47.557078 31681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3fc072197925441bbc0ae3c8b3c1747b" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "17b299aad0624bcfa3896aee89ce5a17"
I20251211 21:02:47.557184 31681 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fc072197925441bbc0ae3c8b3c1747b in current term 2: Already voted for candidate 17b299aad0624bcfa3896aee89ce5a17 in this term.
W20251211 21:02:47.557677 31655 leader_election.cc:336] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507): Network error: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111)
I20251211 21:02:47.557749 31655 leader_election.cc:304] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17b299aad0624bcfa3896aee89ce5a17; no voters: 37d6df32c8984cbe858d80036d1e1e11, 3fc072197925441bbc0ae3c8b3c1747b
W20251211 21:02:47.557796 31524 leader_election.cc:336] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507): Network error: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111)
I20251211 21:02:47.557847 31524 leader_election.cc:304] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fc072197925441bbc0ae3c8b3c1747b; no voters: 17b299aad0624bcfa3896aee89ce5a17, 37d6df32c8984cbe858d80036d1e1e11
I20251211 21:02:47.557879 32053 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251211 21:02:47.558027 32052 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251211 21:02:49.405794 32064 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:49.405941 32064 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:49.406351 32064 leader_election.cc:290] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507), 17b299aad0624bcfa3896aee89ce5a17 (127.29.190.252:33295)
I20251211 21:02:49.406796 31681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3fc072197925441bbc0ae3c8b3c1747b" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "17b299aad0624bcfa3896aee89ce5a17" is_pre_election: true
I20251211 21:02:49.406932 31681 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc072197925441bbc0ae3c8b3c1747b in term 2.
W20251211 21:02:49.406955 31524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20251211 21:02:49.407241 31523 leader_election.cc:304] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b299aad0624bcfa3896aee89ce5a17, 3fc072197925441bbc0ae3c8b3c1747b; no voters:
I20251211 21:02:49.407438 32064 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251211 21:02:49.407498 32064 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:49.407538 32064 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 2 FOLLOWER]: Advancing to term 3
W20251211 21:02:49.407778 31524 leader_election.cc:336] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507): Network error: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111)
I20251211 21:02:49.408643 32064 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:49.408964 32064 leader_election.cc:290] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 3 election: Requested vote from peers 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507), 17b299aad0624bcfa3896aee89ce5a17 (127.29.190.252:33295)
I20251211 21:02:49.409304 31681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3fc072197925441bbc0ae3c8b3c1747b" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "17b299aad0624bcfa3896aee89ce5a17"
I20251211 21:02:49.409420 31681 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 2 FOLLOWER]: Advancing to term 3
W20251211 21:02:49.409793 31524 leader_election.cc:336] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 37d6df32c8984cbe858d80036d1e1e11 (127.29.190.253:38507): Network error: Client connection negotiation failed: client connection to 127.29.190.253:38507: connect: Connection refused (error 111)
I20251211 21:02:49.410338 31681 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc072197925441bbc0ae3c8b3c1747b in term 3.
I20251211 21:02:49.410573 31523 leader_election.cc:304] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17b299aad0624bcfa3896aee89ce5a17, 3fc072197925441bbc0ae3c8b3c1747b; no voters: 37d6df32c8984cbe858d80036d1e1e11
I20251211 21:02:49.410712 32064 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:02:49.410912 32064 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 3 LEADER]: Becoming Leader. State: Replica: 3fc072197925441bbc0ae3c8b3c1747b, State: Running, Role: LEADER
I20251211 21:02:49.411046 32064 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } }
I20251211 21:02:49.411667 32067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fc072197925441bbc0ae3c8b3c1747b. Latest consensus state: current_term: 3 leader_uuid: "3fc072197925441bbc0ae3c8b3c1747b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc072197925441bbc0ae3c8b3c1747b" member_type: VOTER last_known_addr { host: "127.29.190.254" port: 45505 } } peers { permanent_uuid: "37d6df32c8984cbe858d80036d1e1e11" member_type: VOTER last_known_addr { host: "127.29.190.253" port: 38507 } } peers { permanent_uuid: "17b299aad0624bcfa3896aee89ce5a17" member_type: VOTER last_known_addr { host: "127.29.190.252" port: 33295 } } }
I20251211 21:02:49.411756 32067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:49.411991 32069 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:02:49.413015 32069 catalog_manager.cc:679] Loaded metadata for table test-workload [id=4eb4d21059394526a8f58d8901b933b6]
I20251211 21:02:49.413946 32069 tablet_loader.cc:96] loaded metadata for tablet 1f6fd5dc17cc488291f1d98846812751 (table test-workload [id=4eb4d21059394526a8f58d8901b933b6])
I20251211 21:02:49.414144 32069 tablet_loader.cc:96] loaded metadata for tablet 2455b975480347c69a1bcb80055bdf23 (table test-workload [id=4eb4d21059394526a8f58d8901b933b6])
I20251211 21:02:49.414283 32069 tablet_loader.cc:96] loaded metadata for tablet d7c7e8da83c54142a86d129274664262 (table test-workload [id=4eb4d21059394526a8f58d8901b933b6])
I20251211 21:02:49.414366 32069 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:02:49.414744 32069 catalog_manager.cc:1269] Loaded cluster ID: 6fced851e734435687104d75f70cf9a5
I20251211 21:02:49.414786 32069 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:02:49.415323 32069 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:02:49.415766 32069 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: Loaded TSK: 0
I20251211 21:02:49.416203 32069 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:02:49.666924 31735 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:49.667047 31735 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:49.741961 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:02:49.745563 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:49.745779 30459 tablet_replica.cc:333] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251: stopping tablet replica
I20251211 21:02:49.745939 30459 raft_consensus.cc:2243] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:49.746065 30459 raft_consensus.cc:2272] T 2455b975480347c69a1bcb80055bdf23 P 00d3b3db21c448d3a0e1124d9429a251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:49.758513 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:02:49.760651 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:02:49.764914 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:49.765138 30459 tablet_replica.cc:333] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af: stopping tablet replica
I20251211 21:02:49.765240 30459 raft_consensus.cc:2243] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:49.765349 30459 raft_consensus.cc:2272] T 1f6fd5dc17cc488291f1d98846812751 P 44b152c7c5cf4d5baa3a9cc19ee814af [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:49.777792 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:02:49.779973 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:02:49.783716 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:02:49.783951 30459 tablet_replica.cc:333] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc: stopping tablet replica
I20251211 21:02:49.784080 30459 raft_consensus.cc:2243] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:02:49.784193 30459 raft_consensus.cc:2272] T d7c7e8da83c54142a86d129274664262 P 2bca7397227441778ecf0d1ec4fb68dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:49.796844 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:02:49.798768 30459 master.cc:561] Master@127.29.190.254:45505 shutting down...
I20251211 21:02:49.801975 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 3 LEADER]: Raft consensus shutting down.
I20251211 21:02:49.802191 30459 pending_rounds.cc:70] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: Trying to abort 1 pending ops.
I20251211 21:02:49.802268 30459 pending_rounds.cc:77] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: Aborting op as it isn't in flight: id { term: 3 index: 10 } timestamp: 7231434626708951040 op_type: NO_OP noop_request { }
I20251211 21:02:49.802381 30459 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:02:49.802445 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:49.802562 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3fc072197925441bbc0ae3c8b3c1747b: stopping tablet replica
I20251211 21:02:49.815249 30459 master.cc:583] Master@127.29.190.254:45505 shutdown complete.
I20251211 21:02:49.817924 30459 master.cc:561] Master@127.29.190.252:33295 shutting down...
I20251211 21:02:49.821426 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:02:49.821623 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:02:49.821697 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 17b299aad0624bcfa3896aee89ce5a17: stopping tablet replica
I20251211 21:02:49.834451 30459 master.cc:583] Master@127.29.190.252:33295 shutdown complete.
[ OK ] AutoRebalancerTest.NextLeaderResumesAutoRebalancing (6284 ms)
[ RUN ] AutoRebalancerTest.MovesScheduledIfAddTserver
I20251211 21:02:49.842206 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:35687
I20251211 21:02:49.842609 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:49.844460 32070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:49.844559 32073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:49.844708 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:49.844717 32071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:49.844976 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:49.845017 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:49.845033 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486969845033 us; error 0 us; skew 500 ppm
I20251211 21:02:49.845842 30459 webserver.cc:492] Webserver started at http://127.29.190.254:46089/ using document root <none> and password file <none>
I20251211 21:02:49.845978 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:49.846020 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:49.846079 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:49.846441 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "3a3c7787edb344d48e641078bb3513e4"
format_stamp: "Formatted at 2025-12-11 21:02:49 on dist-test-slave-xjj2"
I20251211 21:02:49.847867 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:49.848789 32078 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.849053 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:49.849115 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "3a3c7787edb344d48e641078bb3513e4"
format_stamp: "Formatted at 2025-12-11 21:02:49 on dist-test-slave-xjj2"
I20251211 21:02:49.849188 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:49.867779 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:49.868180 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:49.872026 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:35687
I20251211 21:02:49.874473 32130 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:35687 every 8 connection(s)
I20251211 21:02:49.874931 32131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:49.876837 32131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4: Bootstrap starting.
I20251211 21:02:49.877612 32131 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:49.878574 32131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4: No bootstrap required, opened a new log
I20251211 21:02:49.878953 32131 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3c7787edb344d48e641078bb3513e4" member_type: VOTER }
I20251211 21:02:49.879078 32131 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:49.879117 32131 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a3c7787edb344d48e641078bb3513e4, State: Initialized, Role: FOLLOWER
I20251211 21:02:49.879243 32131 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3c7787edb344d48e641078bb3513e4" member_type: VOTER }
I20251211 21:02:49.879310 32131 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:02:49.879344 32131 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:02:49.879388 32131 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:49.880103 32131 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3c7787edb344d48e641078bb3513e4" member_type: VOTER }
I20251211 21:02:49.880218 32131 leader_election.cc:304] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a3c7787edb344d48e641078bb3513e4; no voters:
I20251211 21:02:49.880410 32131 leader_election.cc:290] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:02:49.880520 32134 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:49.880715 32134 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 1 LEADER]: Becoming Leader. State: Replica: 3a3c7787edb344d48e641078bb3513e4, State: Running, Role: LEADER
I20251211 21:02:49.880827 32131 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:02:49.880844 32134 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3c7787edb344d48e641078bb3513e4" member_type: VOTER }
I20251211 21:02:49.881321 32135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a3c7787edb344d48e641078bb3513e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3c7787edb344d48e641078bb3513e4" member_type: VOTER } }
I20251211 21:02:49.881361 32136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a3c7787edb344d48e641078bb3513e4. Latest consensus state: current_term: 1 leader_uuid: "3a3c7787edb344d48e641078bb3513e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3c7787edb344d48e641078bb3513e4" member_type: VOTER } }
I20251211 21:02:49.881458 32136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:49.881412 32135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [sys.catalog]: This master's current role is: LEADER
I20251211 21:02:49.881927 32141 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:02:49.882725 32141 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:02:49.882872 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:02:49.884457 32141 catalog_manager.cc:1357] Generated new cluster ID: 460b76f0a2054f1bbfa76f278c90a18c
I20251211 21:02:49.884514 32141 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:02:49.890132 32141 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:02:49.890839 32141 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:02:49.897724 32141 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4: Generated new TSK 0
I20251211 21:02:49.897912 32141 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:02:49.898984 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:49.900771 32153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:49.900880 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:49.900771 32155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:49.900926 32152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:49.901197 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:49.901242 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:49.901257 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486969901256 us; error 0 us; skew 500 ppm
I20251211 21:02:49.902048 30459 webserver.cc:492] Webserver started at http://127.29.190.193:36429/ using document root <none> and password file <none>
I20251211 21:02:49.902179 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:49.902223 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:49.902277 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:49.902626 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "7af0414b26b4479fab686edffb0fafa6"
format_stamp: "Formatted at 2025-12-11 21:02:49 on dist-test-slave-xjj2"
I20251211 21:02:49.904042 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:02:49.904922 32160 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.905186 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:49.905253 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "7af0414b26b4479fab686edffb0fafa6"
format_stamp: "Formatted at 2025-12-11 21:02:49 on dist-test-slave-xjj2"
I20251211 21:02:49.905320 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:49.913545 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:49.914060 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:49.914376 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:49.914978 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:49.915030 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.915078 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:49.915109 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.919909 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:46057
I20251211 21:02:49.919930 32223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:46057 every 8 connection(s)
I20251211 21:02:49.920742 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:49.922343 32228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:49.922464 32231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:49.922609 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:49.922729 32229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:49.922940 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:49.922986 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:49.923018 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486969923017 us; error 0 us; skew 500 ppm
I20251211 21:02:49.923959 30459 webserver.cc:492] Webserver started at http://127.29.190.194:45747/ using document root <none> and password file <none>
I20251211 21:02:49.924120 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:49.924181 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:49.924242 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:49.924602 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb"
format_stamp: "Formatted at 2025-12-11 21:02:49 on dist-test-slave-xjj2"
I20251211 21:02:49.925915 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:49.926774 32236 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.927024 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:49.927106 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb"
format_stamp: "Formatted at 2025-12-11 21:02:49 on dist-test-slave-xjj2"
I20251211 21:02:49.927179 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:49.928200 32224 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:02:49.928294 32224 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:49.928525 32224 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:02:49.929112 32095 ts_manager.cc:194] Registered new tserver with Master: 7af0414b26b4479fab686edffb0fafa6 (127.29.190.193:46057)
I20251211 21:02:49.929822 32095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50336
I20251211 21:02:49.940889 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:49.941323 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:49.941646 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:49.942116 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:49.942157 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.942198 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:49.942224 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.946287 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:40981
I20251211 21:02:49.946337 32299 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:40981 every 8 connection(s)
I20251211 21:02:49.947081 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:02:49.949064 32303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:02:49.949077 32306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:49.949229 30459 server_base.cc:1047] running on GCE node
W20251211 21:02:49.949079 32304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:02:49.949801 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:02:49.949846 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:02:49.949867 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486969949866 us; error 0 us; skew 500 ppm
I20251211 21:02:49.950785 30459 webserver.cc:492] Webserver started at http://127.29.190.195:44011/ using document root <none> and password file <none>
I20251211 21:02:49.950948 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:02:49.951009 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:02:49.951079 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:02:49.951546 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "b966bef86ea4471a8e0ae594524eed44"
format_stamp: "Formatted at 2025-12-11 21:02:49 on dist-test-slave-xjj2"
I20251211 21:02:49.951987 32300 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:02:49.952085 32300 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:49.952333 32300 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:02:49.952977 32095 ts_manager.cc:194] Registered new tserver with Master: ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194:40981)
I20251211 21:02:49.953327 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20251211 21:02:49.953544 32095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50346
I20251211 21:02:49.954236 32311 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.954447 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:49.954506 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "b966bef86ea4471a8e0ae594524eed44"
format_stamp: "Formatted at 2025-12-11 21:02:49 on dist-test-slave-xjj2"
I20251211 21:02:49.954576 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:02:49.973085 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:02:49.973548 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:02:49.973851 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:02:49.974347 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:02:49.974396 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.974431 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:02:49.974459 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:02:49.978866 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:42043
I20251211 21:02:49.978933 32374 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:42043 every 8 connection(s)
I20251211 21:02:49.983237 32375 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:02:49.983376 32375 heartbeater.cc:461] Registering TS with master...
I20251211 21:02:49.983629 32375 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:02:49.984218 32095 ts_manager.cc:194] Registered new tserver with Master: b966bef86ea4471a8e0ae594524eed44 (127.29.190.195:42043)
I20251211 21:02:49.984736 32095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50352
I20251211 21:02:49.984828 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005569574s
I20251211 21:02:50.930719 32224 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:02:50.954473 32300 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:02:50.985702 32375 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:02:51.011070 30459 test_util.cc:276] Using random seed: 2009284602
I20251211 21:02:51.019483 32095 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50368:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:02:51.020051 32095 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:02:51.030476 32338 tablet_service.cc:1505] Processing CreateTablet for tablet c5ed5d21d7914c35b128fd4981457e78 (DEFAULT_TABLE table=test-workload [id=e226c5ff71074b52a51bffcb26b9e8e6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20251211 21:02:51.030864 32338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ed5d21d7914c35b128fd4981457e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:51.031569 32188 tablet_service.cc:1505] Processing CreateTablet for tablet 482f79f6fe2e4885b6086ba5452684e0 (DEFAULT_TABLE table=test-workload [id=e226c5ff71074b52a51bffcb26b9e8e6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20251211 21:02:51.030476 32339 tablet_service.cc:1505] Processing CreateTablet for tablet 482f79f6fe2e4885b6086ba5452684e0 (DEFAULT_TABLE table=test-workload [id=e226c5ff71074b52a51bffcb26b9e8e6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20251211 21:02:51.031901 32188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482f79f6fe2e4885b6086ba5452684e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:51.031941 32339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482f79f6fe2e4885b6086ba5452684e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:51.033367 32395 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44: Bootstrap starting.
I20251211 21:02:51.033978 32187 tablet_service.cc:1505] Processing CreateTablet for tablet c5ed5d21d7914c35b128fd4981457e78 (DEFAULT_TABLE table=test-workload [id=e226c5ff71074b52a51bffcb26b9e8e6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20251211 21:02:51.034227 32187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ed5d21d7914c35b128fd4981457e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:51.034488 32395 tablet_bootstrap.cc:654] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:51.035665 32395 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44: No bootstrap required, opened a new log
I20251211 21:02:51.035751 32395 ts_tablet_manager.cc:1403] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:02:51.035876 32263 tablet_service.cc:1505] Processing CreateTablet for tablet c5ed5d21d7914c35b128fd4981457e78 (DEFAULT_TABLE table=test-workload [id=e226c5ff71074b52a51bffcb26b9e8e6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20251211 21:02:51.036090 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ed5d21d7914c35b128fd4981457e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:51.036204 32395 raft_consensus.cc:359] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.036306 32395 raft_consensus.cc:385] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:51.036337 32395 raft_consensus.cc:740] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b966bef86ea4471a8e0ae594524eed44, State: Initialized, Role: FOLLOWER
I20251211 21:02:51.036443 32395 consensus_queue.cc:260] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.036759 32395 ts_tablet_manager.cc:1434] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:51.036896 32395 tablet_bootstrap.cc:492] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44: Bootstrap starting.
I20251211 21:02:51.037801 32395 tablet_bootstrap.cc:654] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:51.038236 32264 tablet_service.cc:1505] Processing CreateTablet for tablet 482f79f6fe2e4885b6086ba5452684e0 (DEFAULT_TABLE table=test-workload [id=e226c5ff71074b52a51bffcb26b9e8e6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20251211 21:02:51.038480 32264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482f79f6fe2e4885b6086ba5452684e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:02:51.038610 32399 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Bootstrap starting.
I20251211 21:02:51.039291 32395 tablet_bootstrap.cc:492] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44: No bootstrap required, opened a new log
I20251211 21:02:51.039379 32395 ts_tablet_manager.cc:1403] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:02:51.039803 32396 tablet_bootstrap.cc:492] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6: Bootstrap starting.
I20251211 21:02:51.039829 32395 raft_consensus.cc:359] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.040047 32395 raft_consensus.cc:385] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:51.040125 32395 raft_consensus.cc:740] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b966bef86ea4471a8e0ae594524eed44, State: Initialized, Role: FOLLOWER
I20251211 21:02:51.040328 32395 consensus_queue.cc:260] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.040601 32399 tablet_bootstrap.cc:654] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:51.040843 32396 tablet_bootstrap.cc:654] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:51.040920 32395 ts_tablet_manager.cc:1434] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:51.042104 32399 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: No bootstrap required, opened a new log
I20251211 21:02:51.042194 32399 ts_tablet_manager.cc:1403] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:02:51.042557 32396 tablet_bootstrap.cc:492] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6: No bootstrap required, opened a new log
I20251211 21:02:51.042629 32396 ts_tablet_manager.cc:1403] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:02:51.042639 32399 raft_consensus.cc:359] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.042769 32399 raft_consensus.cc:385] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:51.042809 32399 raft_consensus.cc:740] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff24cb51f2c84e4b9ba1e1510b89a1eb, State: Initialized, Role: FOLLOWER
I20251211 21:02:51.042929 32399 consensus_queue.cc:260] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.043110 32396 raft_consensus.cc:359] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.043190 32396 raft_consensus.cc:385] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:51.043218 32396 raft_consensus.cc:740] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7af0414b26b4479fab686edffb0fafa6, State: Initialized, Role: FOLLOWER
I20251211 21:02:51.043288 32399 ts_tablet_manager.cc:1434] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:51.043344 32396 consensus_queue.cc:260] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.043443 32399 tablet_bootstrap.cc:492] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Bootstrap starting.
I20251211 21:02:51.043706 32396 ts_tablet_manager.cc:1434] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:51.043859 32396 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6: Bootstrap starting.
I20251211 21:02:51.044520 32399 tablet_bootstrap.cc:654] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:51.044772 32396 tablet_bootstrap.cc:654] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6: Neither blocks nor log segments found. Creating new log.
I20251211 21:02:51.045959 32396 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6: No bootstrap required, opened a new log
I20251211 21:02:51.046015 32399 tablet_bootstrap.cc:492] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb: No bootstrap required, opened a new log
I20251211 21:02:51.046059 32396 ts_tablet_manager.cc:1403] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251211 21:02:51.046080 32399 ts_tablet_manager.cc:1403] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:02:51.046527 32399 raft_consensus.cc:359] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.046527 32396 raft_consensus.cc:359] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.046675 32399 raft_consensus.cc:385] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:51.046684 32396 raft_consensus.cc:385] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:02:51.046716 32399 raft_consensus.cc:740] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff24cb51f2c84e4b9ba1e1510b89a1eb, State: Initialized, Role: FOLLOWER
I20251211 21:02:51.046741 32396 raft_consensus.cc:740] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7af0414b26b4479fab686edffb0fafa6, State: Initialized, Role: FOLLOWER
I20251211 21:02:51.046857 32396 consensus_queue.cc:260] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.046857 32399 consensus_queue.cc:260] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.047137 32396 ts_tablet_manager.cc:1434] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:02:51.047152 32399 ts_tablet_manager.cc:1434] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:02:51.264930 32403 raft_consensus.cc:493] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:51.265084 32403 raft_consensus.cc:515] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.265606 32403 leader_election.cc:290] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b966bef86ea4471a8e0ae594524eed44 (127.29.190.195:42043), 7af0414b26b4479fab686edffb0fafa6 (127.29.190.193:46057)
I20251211 21:02:51.268992 32349 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "482f79f6fe2e4885b6086ba5452684e0" candidate_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b966bef86ea4471a8e0ae594524eed44" is_pre_election: true
I20251211 21:02:51.269001 32198 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "482f79f6fe2e4885b6086ba5452684e0" candidate_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7af0414b26b4479fab686edffb0fafa6" is_pre_election: true
I20251211 21:02:51.269155 32349 raft_consensus.cc:2468] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff24cb51f2c84e4b9ba1e1510b89a1eb in term 0.
I20251211 21:02:51.269179 32198 raft_consensus.cc:2468] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff24cb51f2c84e4b9ba1e1510b89a1eb in term 0.
I20251211 21:02:51.269467 32239 leader_election.cc:304] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7af0414b26b4479fab686edffb0fafa6, ff24cb51f2c84e4b9ba1e1510b89a1eb; no voters:
I20251211 21:02:51.269724 32403 raft_consensus.cc:2804] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:51.269794 32403 raft_consensus.cc:493] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:51.269826 32403 raft_consensus.cc:3060] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:51.270716 32403 raft_consensus.cc:515] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.271067 32403 leader_election.cc:290] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [CANDIDATE]: Term 1 election: Requested vote from peers b966bef86ea4471a8e0ae594524eed44 (127.29.190.195:42043), 7af0414b26b4479fab686edffb0fafa6 (127.29.190.193:46057)
I20251211 21:02:51.271384 32198 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "482f79f6fe2e4885b6086ba5452684e0" candidate_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7af0414b26b4479fab686edffb0fafa6"
I20251211 21:02:51.271384 32349 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "482f79f6fe2e4885b6086ba5452684e0" candidate_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b966bef86ea4471a8e0ae594524eed44"
I20251211 21:02:51.271520 32198 raft_consensus.cc:3060] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:51.271535 32349 raft_consensus.cc:3060] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:51.272517 32198 raft_consensus.cc:2468] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff24cb51f2c84e4b9ba1e1510b89a1eb in term 1.
I20251211 21:02:51.272518 32349 raft_consensus.cc:2468] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff24cb51f2c84e4b9ba1e1510b89a1eb in term 1.
I20251211 21:02:51.272837 32238 leader_election.cc:304] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b966bef86ea4471a8e0ae594524eed44, ff24cb51f2c84e4b9ba1e1510b89a1eb; no voters:
I20251211 21:02:51.272997 32403 raft_consensus.cc:2804] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:51.273217 32403 raft_consensus.cc:697] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 LEADER]: Becoming Leader. State: Replica: ff24cb51f2c84e4b9ba1e1510b89a1eb, State: Running, Role: LEADER
I20251211 21:02:51.273355 32403 consensus_queue.cc:237] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } }
I20251211 21:02:51.274837 32094 catalog_manager.cc:5654] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb reported cstate change: term changed from 0 to 1, leader changed from <none> to ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194). New cstate: current_term: 1 leader_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20251211 21:02:51.346175 32398 raft_consensus.cc:493] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:02:51.346342 32398 raft_consensus.cc:515] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.346817 32398 leader_election.cc:290] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7af0414b26b4479fab686edffb0fafa6 (127.29.190.193:46057), ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194:40981)
I20251211 21:02:51.351159 32274 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5ed5d21d7914c35b128fd4981457e78" candidate_uuid: "b966bef86ea4471a8e0ae594524eed44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" is_pre_election: true
I20251211 21:02:51.351153 32198 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5ed5d21d7914c35b128fd4981457e78" candidate_uuid: "b966bef86ea4471a8e0ae594524eed44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7af0414b26b4479fab686edffb0fafa6" is_pre_election: true
I20251211 21:02:51.351348 32274 raft_consensus.cc:2468] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b966bef86ea4471a8e0ae594524eed44 in term 0.
I20251211 21:02:51.351365 32198 raft_consensus.cc:2468] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b966bef86ea4471a8e0ae594524eed44 in term 0.
I20251211 21:02:51.351656 32314 leader_election.cc:304] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7af0414b26b4479fab686edffb0fafa6, b966bef86ea4471a8e0ae594524eed44; no voters:
I20251211 21:02:51.351811 32398 raft_consensus.cc:2804] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:02:51.351872 32398 raft_consensus.cc:493] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:02:51.351917 32398 raft_consensus.cc:3060] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:51.352761 32398 raft_consensus.cc:515] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.353084 32398 leader_election.cc:290] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [CANDIDATE]: Term 1 election: Requested vote from peers 7af0414b26b4479fab686edffb0fafa6 (127.29.190.193:46057), ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194:40981)
I20251211 21:02:51.353478 32274 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5ed5d21d7914c35b128fd4981457e78" candidate_uuid: "b966bef86ea4471a8e0ae594524eed44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb"
I20251211 21:02:51.353478 32198 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5ed5d21d7914c35b128fd4981457e78" candidate_uuid: "b966bef86ea4471a8e0ae594524eed44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7af0414b26b4479fab686edffb0fafa6"
I20251211 21:02:51.353618 32274 raft_consensus.cc:3060] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:51.353653 32198 raft_consensus.cc:3060] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:02:51.354598 32274 raft_consensus.cc:2468] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b966bef86ea4471a8e0ae594524eed44 in term 1.
I20251211 21:02:51.354598 32198 raft_consensus.cc:2468] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b966bef86ea4471a8e0ae594524eed44 in term 1.
I20251211 21:02:51.354923 32314 leader_election.cc:304] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b966bef86ea4471a8e0ae594524eed44, ff24cb51f2c84e4b9ba1e1510b89a1eb; no voters:
I20251211 21:02:51.355247 32398 raft_consensus.cc:2804] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:02:51.355482 32398 raft_consensus.cc:697] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 1 LEADER]: Becoming Leader. State: Replica: b966bef86ea4471a8e0ae594524eed44, State: Running, Role: LEADER
I20251211 21:02:51.355651 32398 consensus_queue.cc:237] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } }
I20251211 21:02:51.357224 32094 catalog_manager.cc:5654] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 reported cstate change: term changed from 0 to 1, leader changed from <none> to b966bef86ea4471a8e0ae594524eed44 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "b966bef86ea4471a8e0ae594524eed44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } health_report { overall_health: HEALTHY } } }
I20251211 21:02:51.687851 32403 consensus_queue.cc:1048] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:51.690937 32417 consensus_queue.cc:1048] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:51.785415 32398 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:51.788722 32398 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:02:51.882712 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:51.883121 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:02:51.883198 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:53.883517 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:53.883971 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:02:53.884063 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:55.884377 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:55.884806 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:02:55.884881 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:57.885242 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:57.885654 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:02:57.885730 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:02:59.886045 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:02:59.886451 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:02:59.886519 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:01.886857 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:01.887306 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:01.887374 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:02.442525 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:02.444736 32429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:02.444788 32432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:02.444875 30459 server_base.cc:1047] running on GCE node
W20251211 21:03:02.444983 32430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:02.445211 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:02.445261 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:02.445292 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486982445292 us; error 0 us; skew 500 ppm
I20251211 21:03:02.446326 30459 webserver.cc:492] Webserver started at http://127.29.190.196:35133/ using document root <none> and password file <none>
I20251211 21:03:02.446473 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:02.446524 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:02.446602 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:02.446990 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-3-root/instance:
uuid: "efac990358b14834afdaae5c5ef7edd6"
format_stamp: "Formatted at 2025-12-11 21:03:02 on dist-test-slave-xjj2"
I20251211 21:03:02.448493 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:03:02.449417 32437 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:02.449679 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:02.449744 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-3-root
uuid: "efac990358b14834afdaae5c5ef7edd6"
format_stamp: "Formatted at 2025-12-11 21:03:02 on dist-test-slave-xjj2"
I20251211 21:03:02.449818 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:02.484009 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:02.484395 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:02.484710 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:02.485204 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:02.485255 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:02.485293 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:02.485321 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:02.490044 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.196:34951
I20251211 21:03:02.490073 32500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.196:34951 every 8 connection(s)
I20251211 21:03:02.498382 32501 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:03:02.498508 32501 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:02.498755 32501 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:03:02.499377 32094 ts_manager.cc:194] Registered new tserver with Master: efac990358b14834afdaae5c5ef7edd6 (127.29.190.196:34951)
I20251211 21:03:02.499965 32094 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39374
I20251211 21:03:02.897807 32349 consensus_queue.cc:237] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: true } }
I20251211 21:03:02.899299 32274 raft_consensus.cc:1275] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Refusing update from remote peer b966bef86ea4471a8e0ae594524eed44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:03:02.899336 32198 raft_consensus.cc:1275] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Refusing update from remote peer b966bef86ea4471a8e0ae594524eed44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:03:02.899721 32428 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:03:02.899914 32508 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:03:02.901508 32509 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: true } } }
I20251211 21:03:02.901881 32274 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: true } } }
I20251211 21:03:02.901881 32198 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: true } } }
I20251211 21:03:02.904093 32094 catalog_manager.cc:5654] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb reported cstate change: config changed from index -1 to 2, NON_VOTER efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "b966bef86ea4471a8e0ae594524eed44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: true } } }
W20251211 21:03:02.904201 32315 consensus_peers.cc:597] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 -> Peer efac990358b14834afdaae5c5ef7edd6 (127.29.190.196:34951): Couldn't send request to peer efac990358b14834afdaae5c5ef7edd6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5ed5d21d7914c35b128fd4981457e78. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:03:03.317054 32519 ts_tablet_manager.cc:933] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: Initiating tablet copy from peer b966bef86ea4471a8e0ae594524eed44 (127.29.190.195:42043)
I20251211 21:03:03.317634 32519 tablet_copy_client.cc:323] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:42043
I20251211 21:03:03.321946 32359 tablet_copy_service.cc:140] P b966bef86ea4471a8e0ae594524eed44: Received BeginTabletCopySession request for tablet c5ed5d21d7914c35b128fd4981457e78 from peer efac990358b14834afdaae5c5ef7edd6 ({username='slave'} at 127.0.0.1:45846)
I20251211 21:03:03.322110 32359 tablet_copy_service.cc:161] P b966bef86ea4471a8e0ae594524eed44: Beginning new tablet copy session on tablet c5ed5d21d7914c35b128fd4981457e78 from peer efac990358b14834afdaae5c5ef7edd6 at {username='slave'} at 127.0.0.1:45846: session id = efac990358b14834afdaae5c5ef7edd6-c5ed5d21d7914c35b128fd4981457e78
I20251211 21:03:03.323597 32359 tablet_copy_source_session.cc:215] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:03:03.325047 32519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ed5d21d7914c35b128fd4981457e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:03.327240 32519 tablet_copy_client.cc:806] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: tablet copy: Starting download of 0 data blocks...
I20251211 21:03:03.327466 32519 tablet_copy_client.cc:670] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: tablet copy: Starting download of 1 WAL segments...
I20251211 21:03:03.328991 32519 tablet_copy_client.cc:538] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:03:03.330777 32519 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: Bootstrap starting.
I20251211 21:03:03.335451 32519 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:03:03.335726 32519 tablet_bootstrap.cc:492] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: Bootstrap complete.
I20251211 21:03:03.335873 32519 ts_tablet_manager.cc:1403] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.002s
I20251211 21:03:03.336256 32519 raft_consensus.cc:359] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: true } }
I20251211 21:03:03.336362 32519 raft_consensus.cc:740] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: efac990358b14834afdaae5c5ef7edd6, State: Initialized, Role: LEARNER
I20251211 21:03:03.336459 32519 consensus_queue.cc:260] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: true } }
I20251211 21:03:03.336812 32519 ts_tablet_manager.cc:1434] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:03:03.336844 32501 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:03:03.337312 32359 tablet_copy_service.cc:342] P b966bef86ea4471a8e0ae594524eed44: Request end of tablet copy session efac990358b14834afdaae5c5ef7edd6-c5ed5d21d7914c35b128fd4981457e78 received from {username='slave'} at 127.0.0.1:45846
I20251211 21:03:03.337404 32359 tablet_copy_service.cc:434] P b966bef86ea4471a8e0ae594524eed44: ending tablet copy session efac990358b14834afdaae5c5ef7edd6-c5ed5d21d7914c35b128fd4981457e78 on tablet c5ed5d21d7914c35b128fd4981457e78 with peer efac990358b14834afdaae5c5ef7edd6
I20251211 21:03:03.883066 32475 raft_consensus.cc:1217] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251211 21:03:03.887589 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:03.887957 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:03.888028 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:04.498816 32525 raft_consensus.cc:1064] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44: attempting to promote NON_VOTER efac990358b14834afdaae5c5ef7edd6 to VOTER
I20251211 21:03:04.499356 32525 consensus_queue.cc:237] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } }
I20251211 21:03:04.500577 32475 raft_consensus.cc:1275] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 LEARNER]: Refusing update from remote peer b966bef86ea4471a8e0ae594524eed44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:03:04.500629 32198 raft_consensus.cc:1275] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Refusing update from remote peer b966bef86ea4471a8e0ae594524eed44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:03:04.500629 32274 raft_consensus.cc:1275] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Refusing update from remote peer b966bef86ea4471a8e0ae594524eed44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:03:04.501003 32527 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:03:04.501354 32529 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:03:04.502408 32530 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:03:04.503463 32529 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } } }
I20251211 21:03:04.503970 32274 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } } }
I20251211 21:03:04.504782 32475 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } } }
I20251211 21:03:04.505996 32095 catalog_manager.cc:5654] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 reported cstate change: config changed from index 2 to 3, efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b966bef86ea4471a8e0ae594524eed44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:03:04.506032 32198 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, efac990358b14834afdaae5c5ef7edd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "ff24cb51f2c84e4b9ba1e1510b89a1eb" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 40981 } attrs { replace: true } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } } }
I20251211 21:03:04.510043 32348 consensus_queue.cc:237] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } }
I20251211 21:03:04.511059 32198 raft_consensus.cc:1275] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Refusing update from remote peer b966bef86ea4471a8e0ae594524eed44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:03:04.511059 32475 raft_consensus.cc:1275] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 FOLLOWER]: Refusing update from remote peer b966bef86ea4471a8e0ae594524eed44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:03:04.511395 32530 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:03:04.511564 32527 consensus_queue.cc:1048] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:03:04.512943 32530 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } } }
I20251211 21:03:04.513284 32198 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } } }
I20251211 21:03:04.514570 32080 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c5ed5d21d7914c35b128fd4981457e78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:03:04.514712 32475 raft_consensus.cc:2955] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } } }
I20251211 21:03:04.515128 32092 catalog_manager.cc:5654] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 reported cstate change: config changed from index 3 to 4, VOTER ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194) evicted. New cstate: current_term: 1 leader_uuid: "b966bef86ea4471a8e0ae594524eed44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7af0414b26b4479fab686edffb0fafa6" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 46057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b966bef86ea4471a8e0ae594524eed44" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efac990358b14834afdaae5c5ef7edd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 34951 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:03:04.517355 32264 tablet_service.cc:1552] Processing DeleteTablet for tablet c5ed5d21d7914c35b128fd4981457e78 with delete_type TABLET_DATA_TOMBSTONED (TS ff24cb51f2c84e4b9ba1e1510b89a1eb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55692
I20251211 21:03:04.517838 32540 tablet_replica.cc:333] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: stopping tablet replica
I20251211 21:03:04.517966 32540 raft_consensus.cc:2243] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:03:04.518090 32540 raft_consensus.cc:2272] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:04.518690 32540 ts_tablet_manager.cc:1916] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:03:04.520423 32540 ts_tablet_manager.cc:1929] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251211 21:03:04.520495 32540 log.cc:1199] T c5ed5d21d7914c35b128fd4981457e78 P ff24cb51f2c84e4b9ba1e1510b89a1eb: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/c5ed5d21d7914c35b128fd4981457e78
I20251211 21:03:04.520970 32081 catalog_manager.cc:4985] TS ff24cb51f2c84e4b9ba1e1510b89a1eb (127.29.190.194:40981): tablet c5ed5d21d7914c35b128fd4981457e78 (table test-workload [id=e226c5ff71074b52a51bffcb26b9e8e6]) successfully deleted
I20251211 21:03:05.888386 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:05.888751 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:05.888810 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:07.889135 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:07.889524 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:07.889587 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:09.889891 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:09.890252 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:09.890319 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:11.890638 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:11.891049 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:11.891125 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:13.891435 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:13.891878 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:13.891953 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:15.892256 32149 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:15.892652 32149 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:15.892741 32149 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:16.574716 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:03:16.578353 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:16.578564 30459 tablet_replica.cc:333] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6: stopping tablet replica
I20251211 21:03:16.578688 30459 raft_consensus.cc:2243] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:03:16.578851 30459 raft_consensus.cc:2272] T c5ed5d21d7914c35b128fd4981457e78 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:16.579329 30459 tablet_replica.cc:333] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6: stopping tablet replica
I20251211 21:03:16.579418 30459 raft_consensus.cc:2243] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:03:16.579514 30459 raft_consensus.cc:2272] T 482f79f6fe2e4885b6086ba5452684e0 P 7af0414b26b4479fab686edffb0fafa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:16.592303 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
W20251211 21:03:16.594282 32239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.193:46057: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20251211 21:03:16.594671 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
W20251211 21:03:16.595034 32239 consensus_peers.cc:597] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb -> Peer 7af0414b26b4479fab686edffb0fafa6 (127.29.190.193:46057): Couldn't send request to peer 7af0414b26b4479fab686edffb0fafa6. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:46057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:03:16.598644 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:16.599105 30459 tablet_replica.cc:333] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb: stopping tablet replica
I20251211 21:03:16.599225 30459 raft_consensus.cc:2243] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:03:16.599385 30459 raft_consensus.cc:2272] T 482f79f6fe2e4885b6086ba5452684e0 P ff24cb51f2c84e4b9ba1e1510b89a1eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:16.612259 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:03:16.614444 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:03:16.618247 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:16.618453 30459 tablet_replica.cc:333] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44: stopping tablet replica
I20251211 21:03:16.618570 30459 raft_consensus.cc:2243] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:03:16.618697 30459 raft_consensus.cc:2272] T 482f79f6fe2e4885b6086ba5452684e0 P b966bef86ea4471a8e0ae594524eed44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:16.619141 30459 tablet_replica.cc:333] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44: stopping tablet replica
I20251211 21:03:16.619223 30459 raft_consensus.cc:2243] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:03:16.619441 30459 raft_consensus.cc:2272] T c5ed5d21d7914c35b128fd4981457e78 P b966bef86ea4471a8e0ae594524eed44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:16.632313 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:03:16.634442 30459 tablet_server.cc:178] TabletServer@127.29.190.196:0 shutting down...
I20251211 21:03:16.638047 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:16.638244 30459 tablet_replica.cc:333] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6: stopping tablet replica
I20251211 21:03:16.638353 30459 raft_consensus.cc:2243] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:03:16.638473 30459 raft_consensus.cc:2272] T c5ed5d21d7914c35b128fd4981457e78 P efac990358b14834afdaae5c5ef7edd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:16.651763 30459 tablet_server.cc:195] TabletServer@127.29.190.196:0 shutdown complete.
I20251211 21:03:16.653847 30459 master.cc:561] Master@127.29.190.254:35687 shutting down...
I20251211 21:03:16.656973 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:03:16.657127 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:16.657191 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a3c7787edb344d48e641078bb3513e4: stopping tablet replica
I20251211 21:03:16.669402 30459 master.cc:583] Master@127.29.190.254:35687 shutdown complete.
[ OK ] AutoRebalancerTest.MovesScheduledIfAddTserver (26833 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfNoTservers
I20251211 21:03:16.676106 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:37351
I20251211 21:03:16.676434 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:16.678323 32549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:16.678345 32548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:16.678486 32551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:16.678377 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:16.678673 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:16.678720 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:16.678735 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765486996678735 us; error 0 us; skew 500 ppm
I20251211 21:03:16.679482 30459 webserver.cc:492] Webserver started at http://127.29.190.254:39655/ using document root <none> and password file <none>
I20251211 21:03:16.679656 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:16.679704 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:16.679775 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:16.680147 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "6d30a4af3bcf4faa8c6810419d66167c"
format_stamp: "Formatted at 2025-12-11 21:03:16 on dist-test-slave-xjj2"
I20251211 21:03:16.681492 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:03:16.682322 32556 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:16.682534 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:16.682593 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "6d30a4af3bcf4faa8c6810419d66167c"
format_stamp: "Formatted at 2025-12-11 21:03:16 on dist-test-slave-xjj2"
I20251211 21:03:16.682659 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:16.692132 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:16.692484 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:16.696319 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:37351
I20251211 21:03:16.698554 32608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:37351 every 8 connection(s)
I20251211 21:03:16.698993 32609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:16.700799 32609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c: Bootstrap starting.
I20251211 21:03:16.701532 32609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:16.702423 32609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c: No bootstrap required, opened a new log
I20251211 21:03:16.702782 32609 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d30a4af3bcf4faa8c6810419d66167c" member_type: VOTER }
I20251211 21:03:16.702867 32609 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:16.702893 32609 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d30a4af3bcf4faa8c6810419d66167c, State: Initialized, Role: FOLLOWER
I20251211 21:03:16.702993 32609 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d30a4af3bcf4faa8c6810419d66167c" member_type: VOTER }
I20251211 21:03:16.703065 32609 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:03:16.703094 32609 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:03:16.703126 32609 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:16.703928 32609 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d30a4af3bcf4faa8c6810419d66167c" member_type: VOTER }
I20251211 21:03:16.704043 32609 leader_election.cc:304] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d30a4af3bcf4faa8c6810419d66167c; no voters:
I20251211 21:03:16.704181 32609 leader_election.cc:290] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:03:16.704289 32612 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:03:16.704471 32612 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 1 LEADER]: Becoming Leader. State: Replica: 6d30a4af3bcf4faa8c6810419d66167c, State: Running, Role: LEADER
I20251211 21:03:16.704600 32609 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:03:16.704612 32612 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d30a4af3bcf4faa8c6810419d66167c" member_type: VOTER }
I20251211 21:03:16.705032 32613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d30a4af3bcf4faa8c6810419d66167c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d30a4af3bcf4faa8c6810419d66167c" member_type: VOTER } }
I20251211 21:03:16.705060 32614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d30a4af3bcf4faa8c6810419d66167c. Latest consensus state: current_term: 1 leader_uuid: "6d30a4af3bcf4faa8c6810419d66167c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d30a4af3bcf4faa8c6810419d66167c" member_type: VOTER } }
I20251211 21:03:16.705191 32613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [sys.catalog]: This master's current role is: LEADER
I20251211 21:03:16.705484 32614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [sys.catalog]: This master's current role is: LEADER
I20251211 21:03:16.705690 32619 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:03:16.706588 32619 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:03:16.706827 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:03:16.708475 32619 catalog_manager.cc:1357] Generated new cluster ID: 9b51afa1a838478c95fbe096a19a89db
I20251211 21:03:16.708524 32619 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:03:16.718642 32619 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:03:16.719182 32619 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:03:16.726868 32619 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c: Generated new TSK 0
I20251211 21:03:16.727039 32619 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:03:16.738809 30459 internal_mini_cluster.cc:371] 0 TS(s) registered with all masters after 7.4006e-05s
I20251211 21:03:28.816358 30459 master.cc:561] Master@127.29.190.254:37351 shutting down...
I20251211 21:03:28.819305 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:03:28.819487 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:28.819542 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d30a4af3bcf4faa8c6810419d66167c: stopping tablet replica
I20251211 21:03:28.831739 30459 master.cc:583] Master@127.29.190.254:37351 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfNoTservers (12159 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfNoTablets
I20251211 21:03:28.835994 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:41043
I20251211 21:03:28.836287 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:28.837670 32634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:28.837812 32631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:28.837833 32632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:28.838099 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:28.838232 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:28.838265 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:28.838284 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487008838284 us; error 0 us; skew 500 ppm
I20251211 21:03:28.839056 30459 webserver.cc:492] Webserver started at http://127.29.190.254:33271/ using document root <none> and password file <none>
I20251211 21:03:28.839184 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:28.839226 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:28.839295 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:28.839676 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "b07ee9e1e62b4a81b526c935d881fb65"
format_stamp: "Formatted at 2025-12-11 21:03:28 on dist-test-slave-xjj2"
I20251211 21:03:28.841164 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:03:28.842268 32639 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:28.842509 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:28.842579 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "b07ee9e1e62b4a81b526c935d881fb65"
format_stamp: "Formatted at 2025-12-11 21:03:28 on dist-test-slave-xjj2"
I20251211 21:03:28.842645 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:28.855437 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:28.855818 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:28.859887 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:41043
I20251211 21:03:28.860363 32691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:41043 every 8 connection(s)
I20251211 21:03:28.860944 32692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:28.862823 32692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65: Bootstrap starting.
I20251211 21:03:28.863634 32692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:28.864604 32692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65: No bootstrap required, opened a new log
I20251211 21:03:28.865010 32692 raft_consensus.cc:359] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b07ee9e1e62b4a81b526c935d881fb65" member_type: VOTER }
I20251211 21:03:28.865104 32692 raft_consensus.cc:385] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:28.865144 32692 raft_consensus.cc:740] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b07ee9e1e62b4a81b526c935d881fb65, State: Initialized, Role: FOLLOWER
I20251211 21:03:28.865279 32692 consensus_queue.cc:260] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b07ee9e1e62b4a81b526c935d881fb65" member_type: VOTER }
I20251211 21:03:28.865365 32692 raft_consensus.cc:399] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:03:28.865406 32692 raft_consensus.cc:493] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:03:28.865460 32692 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:28.866146 32692 raft_consensus.cc:515] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b07ee9e1e62b4a81b526c935d881fb65" member_type: VOTER }
I20251211 21:03:28.866271 32692 leader_election.cc:304] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b07ee9e1e62b4a81b526c935d881fb65; no voters:
I20251211 21:03:28.866443 32692 leader_election.cc:290] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:03:28.866524 32695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:03:28.866706 32695 raft_consensus.cc:697] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 1 LEADER]: Becoming Leader. State: Replica: b07ee9e1e62b4a81b526c935d881fb65, State: Running, Role: LEADER
I20251211 21:03:28.866837 32695 consensus_queue.cc:237] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b07ee9e1e62b4a81b526c935d881fb65" member_type: VOTER }
I20251211 21:03:28.866900 32692 sys_catalog.cc:565] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:03:28.867218 32696 sys_catalog.cc:455] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b07ee9e1e62b4a81b526c935d881fb65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b07ee9e1e62b4a81b526c935d881fb65" member_type: VOTER } }
I20251211 21:03:28.867246 32697 sys_catalog.cc:455] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b07ee9e1e62b4a81b526c935d881fb65. Latest consensus state: current_term: 1 leader_uuid: "b07ee9e1e62b4a81b526c935d881fb65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b07ee9e1e62b4a81b526c935d881fb65" member_type: VOTER } }
I20251211 21:03:28.867385 32696 sys_catalog.cc:458] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [sys.catalog]: This master's current role is: LEADER
I20251211 21:03:28.867479 32697 sys_catalog.cc:458] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [sys.catalog]: This master's current role is: LEADER
I20251211 21:03:28.867923 32701 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:03:28.868638 32701 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:03:28.868851 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:03:28.870426 32701 catalog_manager.cc:1357] Generated new cluster ID: b8e2337eca0448e1872564d5a7e85c41
I20251211 21:03:28.870471 32701 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:03:28.891773 32701 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:03:28.892364 32701 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:03:28.898981 32701 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65: Generated new TSK 0
I20251211 21:03:28.899169 32701 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:03:28.901058 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:28.902908 32713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:28.902922 32714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:28.902951 32716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:28.903143 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:28.903349 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:28.903391 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:28.903405 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487008903406 us; error 0 us; skew 500 ppm
I20251211 21:03:28.904246 30459 webserver.cc:492] Webserver started at http://127.29.190.193:37379/ using document root <none> and password file <none>
I20251211 21:03:28.904369 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:28.904412 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:28.904471 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:28.904814 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "5399c7279d824699b7af6f28c3b9c848"
format_stamp: "Formatted at 2025-12-11 21:03:28 on dist-test-slave-xjj2"
I20251211 21:03:28.906116 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:03:28.906930 32721 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:28.907137 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:03:28.907197 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "5399c7279d824699b7af6f28c3b9c848"
format_stamp: "Formatted at 2025-12-11 21:03:28 on dist-test-slave-xjj2"
I20251211 21:03:28.907263 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:28.914345 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:28.914747 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:28.915011 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:28.915480 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:28.915520 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:28.915560 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:28.915587 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:28.919394 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:34547
I20251211 21:03:28.919418 316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:34547 every 8 connection(s)
I20251211 21:03:28.920221 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:28.921871 321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:28.922030 324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:28.922150 30459 server_base.cc:1047] running on GCE node
W20251211 21:03:28.922389 322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:28.922602 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:28.922647 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:28.922667 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487008922667 us; error 0 us; skew 500 ppm
I20251211 21:03:28.923517 30459 webserver.cc:492] Webserver started at http://127.29.190.194:42359/ using document root <none> and password file <none>
I20251211 21:03:28.923709 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:28.923770 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:28.923839 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:28.924204 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "054021f0e43d47d88f928a1f3202358b"
format_stamp: "Formatted at 2025-12-11 21:03:28 on dist-test-slave-xjj2"
I20251211 21:03:28.924778 317 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41043
I20251211 21:03:28.924876 317 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:28.925088 317 heartbeater.cc:507] Master 127.29.190.254:41043 requested a full tablet report, sending...
I20251211 21:03:28.925629 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:03:28.925701 32656 ts_manager.cc:194] Registered new tserver with Master: 5399c7279d824699b7af6f28c3b9c848 (127.29.190.193:34547)
I20251211 21:03:28.926446 32656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56852
I20251211 21:03:28.926548 329 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:28.926797 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:28.926857 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "054021f0e43d47d88f928a1f3202358b"
format_stamp: "Formatted at 2025-12-11 21:03:28 on dist-test-slave-xjj2"
I20251211 21:03:28.926921 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:28.954006 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:28.954416 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:28.954704 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:28.955173 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:28.955211 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:28.955252 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:28.955281 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:28.959359 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:40675
I20251211 21:03:28.959394 392 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:40675 every 8 connection(s)
I20251211 21:03:28.960135 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:28.961921 396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:28.962030 397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:28.962116 399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:28.962175 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:28.962381 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:28.962446 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:28.962469 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487008962469 us; error 0 us; skew 500 ppm
I20251211 21:03:28.963395 30459 webserver.cc:492] Webserver started at http://127.29.190.195:37057/ using document root <none> and password file <none>
I20251211 21:03:28.963588 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:28.963677 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:28.963753 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:28.964180 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "1e6bbae871fb436eabfc4f81a913edb7"
format_stamp: "Formatted at 2025-12-11 21:03:28 on dist-test-slave-xjj2"
I20251211 21:03:28.964200 393 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41043
I20251211 21:03:28.964334 393 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:28.964566 393 heartbeater.cc:507] Master 127.29.190.254:41043 requested a full tablet report, sending...
I20251211 21:03:28.965193 32656 ts_manager.cc:194] Registered new tserver with Master: 054021f0e43d47d88f928a1f3202358b (127.29.190.194:40675)
I20251211 21:03:28.965776 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:03:28.965788 32656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56858
I20251211 21:03:28.966746 404 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:28.966991 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:28.967056 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "1e6bbae871fb436eabfc4f81a913edb7"
format_stamp: "Formatted at 2025-12-11 21:03:28 on dist-test-slave-xjj2"
I20251211 21:03:28.967123 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:29.000110 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:29.000590 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:29.000944 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:29.001413 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:29.001463 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:29.001507 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:29.001534 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:29.005913 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:35819
I20251211 21:03:29.005967 467 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:35819 every 8 connection(s)
I20251211 21:03:29.010447 468 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41043
I20251211 21:03:29.010568 468 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:29.010802 468 heartbeater.cc:507] Master 127.29.190.254:41043 requested a full tablet report, sending...
I20251211 21:03:29.011394 32656 ts_manager.cc:194] Registered new tserver with Master: 1e6bbae871fb436eabfc4f81a913edb7 (127.29.190.195:35819)
I20251211 21:03:29.011940 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005625494s
I20251211 21:03:29.011971 32656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56866
I20251211 21:03:29.927384 317 heartbeater.cc:499] Master 127.29.190.254:41043 was elected leader, sending a full tablet report...
I20251211 21:03:29.966697 393 heartbeater.cc:499] Master 127.29.190.254:41043 was elected leader, sending a full tablet report...
I20251211 21:03:30.012806 468 heartbeater.cc:499] Master 127.29.190.254:41043 was elected leader, sending a full tablet report...
I20251211 21:03:30.868917 32710 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:32.869308 32710 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:34.869656 32710 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:36.869998 32710 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:38.870383 32710 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:40.870746 32710 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:41.089967 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:03:41.093215 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:41.105360 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:03:41.107267 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:03:41.110374 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:41.123711 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:03:41.125478 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:03:41.128980 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:41.140718 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:03:41.142547 30459 master.cc:561] Master@127.29.190.254:41043 shutting down...
I20251211 21:03:41.145632 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:03:41.145809 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:41.145875 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P b07ee9e1e62b4a81b526c935d881fb65: stopping tablet replica
I20251211 21:03:41.158092 30459 master.cc:583] Master@127.29.190.254:41043 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfNoTablets (12326 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne
I20251211 21:03:41.162848 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:41423
I20251211 21:03:41.163177 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:41.164901 475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:41.165038 30459 server_base.cc:1047] running on GCE node
W20251211 21:03:41.165114 473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.165086 472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:41.165323 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:41.165367 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:41.165382 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487021165381 us; error 0 us; skew 500 ppm
I20251211 21:03:41.166155 30459 webserver.cc:492] Webserver started at http://127.29.190.254:41295/ using document root <none> and password file <none>
I20251211 21:03:41.166278 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:41.166316 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:41.166379 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:41.166712 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "b310ae168d294c4dbaee1645ff02801d"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.168076 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:03:41.168896 480 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.169137 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:41.169199 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "b310ae168d294c4dbaee1645ff02801d"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.169263 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:41.176398 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:41.176751 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:41.180541 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:41423
I20251211 21:03:41.181922 532 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:41423 every 8 connection(s)
I20251211 21:03:41.182358 533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:41.184191 533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d: Bootstrap starting.
I20251211 21:03:41.184943 533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:41.185813 533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d: No bootstrap required, opened a new log
I20251211 21:03:41.186153 533 raft_consensus.cc:359] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b310ae168d294c4dbaee1645ff02801d" member_type: VOTER }
I20251211 21:03:41.186233 533 raft_consensus.cc:385] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:41.186298 533 raft_consensus.cc:740] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b310ae168d294c4dbaee1645ff02801d, State: Initialized, Role: FOLLOWER
I20251211 21:03:41.186425 533 consensus_queue.cc:260] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b310ae168d294c4dbaee1645ff02801d" member_type: VOTER }
I20251211 21:03:41.186491 533 raft_consensus.cc:399] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:03:41.186525 533 raft_consensus.cc:493] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:03:41.186570 533 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:41.187199 533 raft_consensus.cc:515] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b310ae168d294c4dbaee1645ff02801d" member_type: VOTER }
I20251211 21:03:41.187315 533 leader_election.cc:304] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b310ae168d294c4dbaee1645ff02801d; no voters:
I20251211 21:03:41.187476 533 leader_election.cc:290] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:03:41.187572 536 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:03:41.187776 536 raft_consensus.cc:697] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 1 LEADER]: Becoming Leader. State: Replica: b310ae168d294c4dbaee1645ff02801d, State: Running, Role: LEADER
I20251211 21:03:41.187884 533 sys_catalog.cc:565] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:03:41.187894 536 consensus_queue.cc:237] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b310ae168d294c4dbaee1645ff02801d" member_type: VOTER }
I20251211 21:03:41.188308 537 sys_catalog.cc:455] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b310ae168d294c4dbaee1645ff02801d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b310ae168d294c4dbaee1645ff02801d" member_type: VOTER } }
I20251211 21:03:41.188393 537 sys_catalog.cc:458] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [sys.catalog]: This master's current role is: LEADER
I20251211 21:03:41.188362 538 sys_catalog.cc:455] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b310ae168d294c4dbaee1645ff02801d. Latest consensus state: current_term: 1 leader_uuid: "b310ae168d294c4dbaee1645ff02801d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b310ae168d294c4dbaee1645ff02801d" member_type: VOTER } }
I20251211 21:03:41.188441 538 sys_catalog.cc:458] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [sys.catalog]: This master's current role is: LEADER
I20251211 21:03:41.188911 541 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:03:41.189570 541 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:03:41.189776 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:03:41.191241 541 catalog_manager.cc:1357] Generated new cluster ID: 91360e2ce96a4168b51c0e2dd7a05718
I20251211 21:03:41.191298 541 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:03:41.197281 541 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:03:41.197834 541 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:03:41.202889 541 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d: Generated new TSK 0
I20251211 21:03:41.203055 541 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:03:41.205785 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:41.207566 554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.207666 555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.207690 557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:41.207775 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:41.208050 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:41.208096 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:41.208109 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487021208110 us; error 0 us; skew 500 ppm
I20251211 21:03:41.208868 30459 webserver.cc:492] Webserver started at http://127.29.190.193:44911/ using document root <none> and password file <none>
I20251211 21:03:41.208992 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:41.209033 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:41.209082 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:41.209407 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "c40f6912bd554ad0827b8b9c357dd831"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.210721 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:41.211675 562 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.211938 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:41.211998 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "c40f6912bd554ad0827b8b9c357dd831"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.212054 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:41.226925 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:41.227329 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:41.227586 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:41.228106 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:41.228144 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.228178 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:41.228206 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.232365 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:42307
I20251211 21:03:41.232416 625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:42307 every 8 connection(s)
I20251211 21:03:41.233186 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:41.235005 631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.235121 630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.235219 633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:41.235273 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:41.235436 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:41.235477 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:41.235500 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487021235500 us; error 0 us; skew 500 ppm
I20251211 21:03:41.236485 30459 webserver.cc:492] Webserver started at http://127.29.190.194:45137/ using document root <none> and password file <none>
I20251211 21:03:41.236639 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:41.236706 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:41.236779 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:41.237171 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "6a44f180f60a47faa62aa47c605a0926"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.238555 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:41.239439 638 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.239727 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:41.239828 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "6a44f180f60a47faa62aa47c605a0926"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.239892 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:41.241135 626 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41423
I20251211 21:03:41.241230 626 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:41.241451 626 heartbeater.cc:507] Master 127.29.190.254:41423 requested a full tablet report, sending...
I20251211 21:03:41.242025 497 ts_manager.cc:194] Registered new tserver with Master: c40f6912bd554ad0827b8b9c357dd831 (127.29.190.193:42307)
I20251211 21:03:41.242726 497 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51394
I20251211 21:03:41.264444 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:41.264861 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:41.265152 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:41.265622 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:41.265661 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.265703 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:41.265730 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.269997 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:42019
I20251211 21:03:41.270058 701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:42019 every 8 connection(s)
I20251211 21:03:41.270833 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:41.272567 706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.272579 705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.272782 708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:41.272838 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:41.273038 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:41.273079 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:41.273106 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487021273106 us; error 0 us; skew 500 ppm
I20251211 21:03:41.274029 30459 webserver.cc:492] Webserver started at http://127.29.190.195:37863/ using document root <none> and password file <none>
I20251211 21:03:41.274176 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:41.274233 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:41.274318 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:41.274735 702 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41423
I20251211 21:03:41.274761 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "6ea5ac3395884bef986220d406273db6"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.274832 702 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:41.275029 702 heartbeater.cc:507] Master 127.29.190.254:41423 requested a full tablet report, sending...
I20251211 21:03:41.275671 497 ts_manager.cc:194] Registered new tserver with Master: 6a44f180f60a47faa62aa47c605a0926 (127.29.190.194:42019)
I20251211 21:03:41.276286 497 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51402
I20251211 21:03:41.276387 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:03:41.277274 713 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.277495 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:03:41.277554 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "6ea5ac3395884bef986220d406273db6"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.277617 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:41.287250 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:41.287690 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:41.287966 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:41.288403 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:41.288440 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.288470 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:41.288483 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.292922 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:45709
I20251211 21:03:41.292980 776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:45709 every 8 connection(s)
I20251211 21:03:41.293702 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:41.295343 780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.295356 781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:41.295435 783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:41.295658 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:41.295827 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:41.295864 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:41.295879 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487021295879 us; error 0 us; skew 500 ppm
I20251211 21:03:41.296741 30459 webserver.cc:492] Webserver started at http://127.29.190.196:41025/ using document root <none> and password file <none>
I20251211 21:03:41.296875 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:41.296932 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:41.297003 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:41.297472 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-3-root/instance:
uuid: "bc8aaaedecb74c0a9621d993b23e259f"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.297732 777 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41423
I20251211 21:03:41.297824 777 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:41.298023 777 heartbeater.cc:507] Master 127.29.190.254:41423 requested a full tablet report, sending...
I20251211 21:03:41.298607 497 ts_manager.cc:194] Registered new tserver with Master: 6ea5ac3395884bef986220d406273db6 (127.29.190.195:45709)
I20251211 21:03:41.299024 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 21:03:41.299172 497 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51412
I20251211 21:03:41.299954 788 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.300191 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:03:41.300256 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-3-root
uuid: "bc8aaaedecb74c0a9621d993b23e259f"
format_stamp: "Formatted at 2025-12-11 21:03:41 on dist-test-slave-xjj2"
I20251211 21:03:41.300314 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765486953797919-30459-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:41.328506 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:41.328922 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:41.329167 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:41.329649 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:41.329689 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.329720 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:41.329746 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:41.334133 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.196:33623
I20251211 21:03:41.334199 851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.196:33623 every 8 connection(s)
I20251211 21:03:41.338176 852 heartbeater.cc:344] Connected to a master server at 127.29.190.254:41423
I20251211 21:03:41.338279 852 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:41.338506 852 heartbeater.cc:507] Master 127.29.190.254:41423 requested a full tablet report, sending...
I20251211 21:03:41.339039 497 ts_manager.cc:194] Registered new tserver with Master: bc8aaaedecb74c0a9621d993b23e259f (127.29.190.196:33623)
I20251211 21:03:41.339535 497 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51416
I20251211 21:03:41.340061 30459 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.005550934s
I20251211 21:03:42.243559 626 heartbeater.cc:499] Master 127.29.190.254:41423 was elected leader, sending a full tablet report...
I20251211 21:03:42.277101 702 heartbeater.cc:499] Master 127.29.190.254:41423 was elected leader, sending a full tablet report...
I20251211 21:03:42.300064 777 heartbeater.cc:499] Master 127.29.190.254:41423 was elected leader, sending a full tablet report...
I20251211 21:03:42.340427 852 heartbeater.cc:499] Master 127.29.190.254:41423 was elected leader, sending a full tablet report...
I20251211 21:03:42.370645 30459 test_util.cc:276] Using random seed: 2060644179
I20251211 21:03:42.377843 497 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51436:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251211 21:03:42.387732 816 tablet_service.cc:1505] Processing CreateTablet for tablet 9d0a692c2d5b46df9486b5655d9a90e5 (DEFAULT_TABLE table=test-workload [id=3010b8d8f3d343998fa7eb7b7c5a7be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:03:42.387881 590 tablet_service.cc:1505] Processing CreateTablet for tablet 9d0a692c2d5b46df9486b5655d9a90e5 (DEFAULT_TABLE table=test-workload [id=3010b8d8f3d343998fa7eb7b7c5a7be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:03:42.388054 816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0a692c2d5b46df9486b5655d9a90e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:42.388012 741 tablet_service.cc:1505] Processing CreateTablet for tablet 9d0a692c2d5b46df9486b5655d9a90e5 (DEFAULT_TABLE table=test-workload [id=3010b8d8f3d343998fa7eb7b7c5a7be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:03:42.388163 590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0a692c2d5b46df9486b5655d9a90e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:42.388245 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0a692c2d5b46df9486b5655d9a90e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:42.390463 873 tablet_bootstrap.cc:492] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831: Bootstrap starting.
I20251211 21:03:42.390709 874 tablet_bootstrap.cc:492] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6: Bootstrap starting.
I20251211 21:03:42.391341 873 tablet_bootstrap.cc:654] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:42.391461 874 tablet_bootstrap.cc:654] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:42.392020 875 tablet_bootstrap.cc:492] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f: Bootstrap starting.
I20251211 21:03:42.392655 874 tablet_bootstrap.cc:492] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6: No bootstrap required, opened a new log
I20251211 21:03:42.392652 873 tablet_bootstrap.cc:492] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831: No bootstrap required, opened a new log
I20251211 21:03:42.392753 874 ts_tablet_manager.cc:1403] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:03:42.392953 873 ts_tablet_manager.cc:1403] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:03:42.392957 875 tablet_bootstrap.cc:654] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:42.393245 874 raft_consensus.cc:359] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.393339 874 raft_consensus.cc:385] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:42.393374 874 raft_consensus.cc:740] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea5ac3395884bef986220d406273db6, State: Initialized, Role: FOLLOWER
I20251211 21:03:42.393467 873 raft_consensus.cc:359] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.393509 874 consensus_queue.cc:260] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.393571 873 raft_consensus.cc:385] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:42.393616 873 raft_consensus.cc:740] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c40f6912bd554ad0827b8b9c357dd831, State: Initialized, Role: FOLLOWER
I20251211 21:03:42.393731 873 consensus_queue.cc:260] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.393834 874 ts_tablet_manager.cc:1434] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:42.394034 873 ts_tablet_manager.cc:1434] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:42.394182 875 tablet_bootstrap.cc:492] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f: No bootstrap required, opened a new log
I20251211 21:03:42.394239 875 ts_tablet_manager.cc:1403] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:03:42.394613 875 raft_consensus.cc:359] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.394707 875 raft_consensus.cc:385] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:42.394738 875 raft_consensus.cc:740] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc8aaaedecb74c0a9621d993b23e259f, State: Initialized, Role: FOLLOWER
I20251211 21:03:42.394846 875 consensus_queue.cc:260] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.395151 875 ts_tablet_manager.cc:1434] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251211 21:03:42.484102 627 tablet.cc:2378] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 21:03:42.564183 880 raft_consensus.cc:493] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:03:42.564333 880 raft_consensus.cc:515] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.564817 880 leader_election.cc:290] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc8aaaedecb74c0a9621d993b23e259f (127.29.190.196:33623), 6ea5ac3395884bef986220d406273db6 (127.29.190.195:45709)
I20251211 21:03:42.569031 751 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d0a692c2d5b46df9486b5655d9a90e5" candidate_uuid: "c40f6912bd554ad0827b8b9c357dd831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea5ac3395884bef986220d406273db6" is_pre_election: true
I20251211 21:03:42.569166 751 raft_consensus.cc:2468] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c40f6912bd554ad0827b8b9c357dd831 in term 0.
I20251211 21:03:42.569392 826 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d0a692c2d5b46df9486b5655d9a90e5" candidate_uuid: "c40f6912bd554ad0827b8b9c357dd831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8aaaedecb74c0a9621d993b23e259f" is_pre_election: true
I20251211 21:03:42.569440 564 leader_election.cc:304] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea5ac3395884bef986220d406273db6, c40f6912bd554ad0827b8b9c357dd831; no voters:
I20251211 21:03:42.569502 826 raft_consensus.cc:2468] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c40f6912bd554ad0827b8b9c357dd831 in term 0.
I20251211 21:03:42.569638 880 raft_consensus.cc:2804] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:03:42.569700 880 raft_consensus.cc:493] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:03:42.569741 880 raft_consensus.cc:3060] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:42.570614 880 raft_consensus.cc:515] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.570914 880 leader_election.cc:290] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [CANDIDATE]: Term 1 election: Requested vote from peers bc8aaaedecb74c0a9621d993b23e259f (127.29.190.196:33623), 6ea5ac3395884bef986220d406273db6 (127.29.190.195:45709)
I20251211 21:03:42.571187 826 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d0a692c2d5b46df9486b5655d9a90e5" candidate_uuid: "c40f6912bd554ad0827b8b9c357dd831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8aaaedecb74c0a9621d993b23e259f"
I20251211 21:03:42.571230 751 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d0a692c2d5b46df9486b5655d9a90e5" candidate_uuid: "c40f6912bd554ad0827b8b9c357dd831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea5ac3395884bef986220d406273db6"
I20251211 21:03:42.571272 826 raft_consensus.cc:3060] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:42.571353 751 raft_consensus.cc:3060] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:42.572208 826 raft_consensus.cc:2468] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c40f6912bd554ad0827b8b9c357dd831 in term 1.
I20251211 21:03:42.572249 751 raft_consensus.cc:2468] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c40f6912bd554ad0827b8b9c357dd831 in term 1.
I20251211 21:03:42.572510 564 leader_election.cc:304] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea5ac3395884bef986220d406273db6, c40f6912bd554ad0827b8b9c357dd831; no voters:
I20251211 21:03:42.572651 880 raft_consensus.cc:2804] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:03:42.572818 880 raft_consensus.cc:697] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 1 LEADER]: Becoming Leader. State: Replica: c40f6912bd554ad0827b8b9c357dd831, State: Running, Role: LEADER
I20251211 21:03:42.572942 880 consensus_queue.cc:237] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } }
I20251211 21:03:42.574337 497 catalog_manager.cc:5654] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 reported cstate change: term changed from 0 to 1, leader changed from <none> to c40f6912bd554ad0827b8b9c357dd831 (127.29.190.193). New cstate: current_term: 1 leader_uuid: "c40f6912bd554ad0827b8b9c357dd831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c40f6912bd554ad0827b8b9c357dd831" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 42307 } health_report { overall_health: HEALTHY } } }
I20251211 21:03:42.977367 880 consensus_queue.cc:1048] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc8aaaedecb74c0a9621d993b23e259f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:03:42.980243 889 consensus_queue.cc:1048] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea5ac3395884bef986220d406273db6" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:03:43.189724 551 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:43.190002 551 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:43.190064 551 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:45.190372 551 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:45.190696 551 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:45.190766 551 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:47.191074 551 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:47.191401 551 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:47.191465 551 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:49.191794 551 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:49.192080 551 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:49.192137 551 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:51.192425 551 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:51.192708 551 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:51.192757 551 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:53.193085 551 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:53.193377 551 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:53.193446 551 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:53.669183 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:03:53.672638 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:53.672832 30459 tablet_replica.cc:333] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831: stopping tablet replica
I20251211 21:03:53.672951 30459 raft_consensus.cc:2243] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:03:53.673166 30459 raft_consensus.cc:2272] T 9d0a692c2d5b46df9486b5655d9a90e5 P c40f6912bd554ad0827b8b9c357dd831 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:53.686705 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:03:53.688723 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:03:53.692631 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:53.704437 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:03:53.706182 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:03:53.710033 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:53.710242 30459 tablet_replica.cc:333] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6: stopping tablet replica
I20251211 21:03:53.710364 30459 raft_consensus.cc:2243] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:03:53.710489 30459 raft_consensus.cc:2272] T 9d0a692c2d5b46df9486b5655d9a90e5 P 6ea5ac3395884bef986220d406273db6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:53.722733 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:03:53.724656 30459 tablet_server.cc:178] TabletServer@127.29.190.196:0 shutting down...
I20251211 21:03:53.728629 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:03:53.728802 30459 tablet_replica.cc:333] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f: stopping tablet replica
I20251211 21:03:53.728904 30459 raft_consensus.cc:2243] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:03:53.729017 30459 raft_consensus.cc:2272] T 9d0a692c2d5b46df9486b5655d9a90e5 P bc8aaaedecb74c0a9621d993b23e259f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:53.741441 30459 tablet_server.cc:195] TabletServer@127.29.190.196:0 shutdown complete.
I20251211 21:03:53.743323 30459 master.cc:561] Master@127.29.190.254:41423 shutting down...
I20251211 21:03:53.746802 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:03:53.746977 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:03:53.747082 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P b310ae168d294c4dbaee1645ff02801d: stopping tablet replica
I20251211 21:03:53.759403 30459 master.cc:583] Master@127.29.190.254:41423 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne (12602 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy
I20251211 21:03:53.765556 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:34395
I20251211 21:03:53.765882 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:03:53.767459 30459 server_base.cc:1047] running on GCE node
W20251211 21:03:53.767588 895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:53.767587 896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:53.767494 898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:53.767923 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:53.767966 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:53.767979 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487033767979 us; error 0 us; skew 500 ppm
I20251211 21:03:53.768862 30459 webserver.cc:492] Webserver started at http://127.29.190.254:46207/ using document root <none> and password file <none>
I20251211 21:03:53.768996 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:53.769037 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:53.769109 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:53.769484 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "f6d9b8cfb51a407cb3c488eab219662b"
format_stamp: "Formatted at 2025-12-11 21:03:53 on dist-test-slave-xjj2"
I20251211 21:03:53.770781 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:53.771575 903 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.771849 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:53.771909 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "f6d9b8cfb51a407cb3c488eab219662b"
format_stamp: "Formatted at 2025-12-11 21:03:53 on dist-test-slave-xjj2"
I20251211 21:03:53.771963 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:53.792567 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:53.792886 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:53.796739 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:34395
I20251211 21:03:53.798466 955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:34395 every 8 connection(s)
I20251211 21:03:53.798950 956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:53.800805 956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b: Bootstrap starting.
I20251211 21:03:53.801584 956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:53.802449 956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b: No bootstrap required, opened a new log
I20251211 21:03:53.802794 956 raft_consensus.cc:359] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d9b8cfb51a407cb3c488eab219662b" member_type: VOTER }
I20251211 21:03:53.802878 956 raft_consensus.cc:385] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:53.802908 956 raft_consensus.cc:740] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d9b8cfb51a407cb3c488eab219662b, State: Initialized, Role: FOLLOWER
I20251211 21:03:53.803028 956 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d9b8cfb51a407cb3c488eab219662b" member_type: VOTER }
I20251211 21:03:53.803104 956 raft_consensus.cc:399] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:03:53.803148 956 raft_consensus.cc:493] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:03:53.803195 956 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:53.803849 956 raft_consensus.cc:515] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d9b8cfb51a407cb3c488eab219662b" member_type: VOTER }
I20251211 21:03:53.803963 956 leader_election.cc:304] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6d9b8cfb51a407cb3c488eab219662b; no voters:
I20251211 21:03:53.804112 956 leader_election.cc:290] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:03:53.804271 959 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:03:53.804477 959 raft_consensus.cc:697] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 1 LEADER]: Becoming Leader. State: Replica: f6d9b8cfb51a407cb3c488eab219662b, State: Running, Role: LEADER
I20251211 21:03:53.804541 956 sys_catalog.cc:565] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:03:53.804608 959 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d9b8cfb51a407cb3c488eab219662b" member_type: VOTER }
I20251211 21:03:53.805028 960 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6d9b8cfb51a407cb3c488eab219662b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d9b8cfb51a407cb3c488eab219662b" member_type: VOTER } }
I20251211 21:03:53.805066 961 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6d9b8cfb51a407cb3c488eab219662b. Latest consensus state: current_term: 1 leader_uuid: "f6d9b8cfb51a407cb3c488eab219662b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d9b8cfb51a407cb3c488eab219662b" member_type: VOTER } }
I20251211 21:03:53.805166 961 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [sys.catalog]: This master's current role is: LEADER
I20251211 21:03:53.805117 960 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [sys.catalog]: This master's current role is: LEADER
I20251211 21:03:53.805725 967 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:03:53.806490 967 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:03:53.806650 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:03:53.808357 967 catalog_manager.cc:1357] Generated new cluster ID: 13c0a7e51f2346acbf500dda130fe151
I20251211 21:03:53.808415 967 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:03:53.813352 967 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:03:53.813889 967 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:03:53.827544 967 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b: Generated new TSK 0
I20251211 21:03:53.827795 967 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:03:53.839129 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:53.841177 978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:53.841205 977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:53.841305 980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:53.841419 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:53.841636 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:53.841676 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:53.841691 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487033841690 us; error 0 us; skew 500 ppm
I20251211 21:03:53.842542 30459 webserver.cc:492] Webserver started at http://127.29.190.193:41103/ using document root <none> and password file <none>
I20251211 21:03:53.842700 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:53.842749 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:53.842820 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:53.843211 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "9a09f73250c946b38f9d50e9161aeca0"
format_stamp: "Formatted at 2025-12-11 21:03:53 on dist-test-slave-xjj2"
I20251211 21:03:53.844587 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:03:53.845400 985 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.845593 30459 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251211 21:03:53.845652 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "9a09f73250c946b38f9d50e9161aeca0"
format_stamp: "Formatted at 2025-12-11 21:03:53 on dist-test-slave-xjj2"
I20251211 21:03:53.845712 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:53.865036 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:53.865465 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:53.865741 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:53.866204 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:53.866251 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.866293 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:53.866319 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.870163 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:37149
I20251211 21:03:53.870189 1048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:37149 every 8 connection(s)
I20251211 21:03:53.870886 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:53.872629 1054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:53.872645 1053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:53.872845 30459 server_base.cc:1047] running on GCE node
W20251211 21:03:53.872709 1056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:53.873134 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:53.873180 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:53.873205 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487033873205 us; error 0 us; skew 500 ppm
I20251211 21:03:53.874023 30459 webserver.cc:492] Webserver started at http://127.29.190.194:45003/ using document root <none> and password file <none>
I20251211 21:03:53.874190 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:53.874251 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:53.874325 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:53.874774 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "4ab680f516534f8290e859c48d9d83b0"
format_stamp: "Formatted at 2025-12-11 21:03:53 on dist-test-slave-xjj2"
I20251211 21:03:53.876250 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:03:53.877194 1061 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.877467 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:53.877550 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "4ab680f516534f8290e859c48d9d83b0"
format_stamp: "Formatted at 2025-12-11 21:03:53 on dist-test-slave-xjj2"
I20251211 21:03:53.877624 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:53.878144 1049 heartbeater.cc:344] Connected to a master server at 127.29.190.254:34395
I20251211 21:03:53.878240 1049 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:53.878492 1049 heartbeater.cc:507] Master 127.29.190.254:34395 requested a full tablet report, sending...
I20251211 21:03:53.879086 920 ts_manager.cc:194] Registered new tserver with Master: 9a09f73250c946b38f9d50e9161aeca0 (127.29.190.193:37149)
I20251211 21:03:53.880105 920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58880
I20251211 21:03:53.889343 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:53.889705 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:53.889950 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:53.890413 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:53.890451 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.890494 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:53.890520 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.894356 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:46397
I20251211 21:03:53.894414 1124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:46397 every 8 connection(s)
I20251211 21:03:53.895130 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:03:53.896924 1129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:53.896935 1128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:03:53.896936 1131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:03:53.897185 30459 server_base.cc:1047] running on GCE node
I20251211 21:03:53.897352 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:03:53.897399 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:03:53.897424 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487033897424 us; error 0 us; skew 500 ppm
I20251211 21:03:53.898319 30459 webserver.cc:492] Webserver started at http://127.29.190.195:43183/ using document root <none> and password file <none>
I20251211 21:03:53.898458 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:03:53.898510 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:03:53.898607 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:03:53.899049 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9"
format_stamp: "Formatted at 2025-12-11 21:03:53 on dist-test-slave-xjj2"
I20251211 21:03:53.899144 1125 heartbeater.cc:344] Connected to a master server at 127.29.190.254:34395
I20251211 21:03:53.899226 1125 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:53.899410 1125 heartbeater.cc:507] Master 127.29.190.254:34395 requested a full tablet report, sending...
I20251211 21:03:53.899987 920 ts_manager.cc:194] Registered new tserver with Master: 4ab680f516534f8290e859c48d9d83b0 (127.29.190.194:46397)
I20251211 21:03:53.900528 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:03:53.900573 920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58886
I20251211 21:03:53.901412 1136 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.901605 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:53.901665 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9"
format_stamp: "Formatted at 2025-12-11 21:03:53 on dist-test-slave-xjj2"
I20251211 21:03:53.901727 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:03:53.907812 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:03:53.908161 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:03:53.908422 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:03:53.908823 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:03:53.908860 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.908898 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:03:53.908926 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:03:53.913208 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:46433
I20251211 21:03:53.913298 1199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:46433 every 8 connection(s)
I20251211 21:03:53.917291 1200 heartbeater.cc:344] Connected to a master server at 127.29.190.254:34395
I20251211 21:03:53.917395 1200 heartbeater.cc:461] Registering TS with master...
I20251211 21:03:53.917593 1200 heartbeater.cc:507] Master 127.29.190.254:34395 requested a full tablet report, sending...
I20251211 21:03:53.918154 920 ts_manager.cc:194] Registered new tserver with Master: ea6a2cdd3dc547cd8b22c2de1ee337d9 (127.29.190.195:46433)
I20251211 21:03:53.918635 920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58894
I20251211 21:03:53.919093 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00554927s
I20251211 21:03:54.880955 1049 heartbeater.cc:499] Master 127.29.190.254:34395 was elected leader, sending a full tablet report...
I20251211 21:03:54.901373 1125 heartbeater.cc:499] Master 127.29.190.254:34395 was elected leader, sending a full tablet report...
I20251211 21:03:54.919535 1200 heartbeater.cc:499] Master 127.29.190.254:34395 was elected leader, sending a full tablet report...
I20251211 21:03:54.949319 30459 test_util.cc:276] Using random seed: 2073222853
I20251211 21:03:54.956343 920 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58900:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:03:54.956758 920 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:03:54.965783 1013 tablet_service.cc:1505] Processing CreateTablet for tablet 88e9b66e61bc4c9e8eb98771ceca9b85 (DEFAULT_TABLE table=test-workload [id=d24cb9b1f0ae4137814718d7b9cdd159]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:03:54.965937 1164 tablet_service.cc:1505] Processing CreateTablet for tablet 88e9b66e61bc4c9e8eb98771ceca9b85 (DEFAULT_TABLE table=test-workload [id=d24cb9b1f0ae4137814718d7b9cdd159]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:03:54.966104 1013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e9b66e61bc4c9e8eb98771ceca9b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:54.966121 1164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e9b66e61bc4c9e8eb98771ceca9b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:54.966627 1089 tablet_service.cc:1505] Processing CreateTablet for tablet 88e9b66e61bc4c9e8eb98771ceca9b85 (DEFAULT_TABLE table=test-workload [id=d24cb9b1f0ae4137814718d7b9cdd159]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:03:54.966841 1089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e9b66e61bc4c9e8eb98771ceca9b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:03:54.968797 1222 tablet_bootstrap.cc:492] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9: Bootstrap starting.
I20251211 21:03:54.968842 1223 tablet_bootstrap.cc:492] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0: Bootstrap starting.
I20251211 21:03:54.969645 1222 tablet_bootstrap.cc:654] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:54.969664 1223 tablet_bootstrap.cc:654] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:54.970252 1221 tablet_bootstrap.cc:492] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0: Bootstrap starting.
I20251211 21:03:54.970746 1223 tablet_bootstrap.cc:492] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0: No bootstrap required, opened a new log
I20251211 21:03:54.970824 1222 tablet_bootstrap.cc:492] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9: No bootstrap required, opened a new log
I20251211 21:03:54.970829 1223 ts_tablet_manager.cc:1403] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:03:54.970925 1222 ts_tablet_manager.cc:1403] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:03:54.971119 1221 tablet_bootstrap.cc:654] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0: Neither blocks nor log segments found. Creating new log.
I20251211 21:03:54.971311 1223 raft_consensus.cc:359] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:54.971339 1222 raft_consensus.cc:359] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:54.971508 1223 raft_consensus.cc:385] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:54.971542 1222 raft_consensus.cc:385] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:54.971550 1223 raft_consensus.cc:740] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab680f516534f8290e859c48d9d83b0, State: Initialized, Role: FOLLOWER
I20251211 21:03:54.971665 1222 raft_consensus.cc:740] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea6a2cdd3dc547cd8b22c2de1ee337d9, State: Initialized, Role: FOLLOWER
I20251211 21:03:54.971843 1223 consensus_queue.cc:260] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:54.971881 1222 consensus_queue.cc:260] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:54.972190 1223 ts_tablet_manager.cc:1434] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:54.972234 1222 ts_tablet_manager.cc:1434] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:54.973176 1221 tablet_bootstrap.cc:492] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0: No bootstrap required, opened a new log
I20251211 21:03:54.973274 1221 ts_tablet_manager.cc:1403] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:03:54.973672 1221 raft_consensus.cc:359] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:54.973766 1221 raft_consensus.cc:385] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:03:54.973802 1221 raft_consensus.cc:740] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a09f73250c946b38f9d50e9161aeca0, State: Initialized, Role: FOLLOWER
I20251211 21:03:54.973913 1221 consensus_queue.cc:260] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:54.974400 1221 ts_tablet_manager.cc:1434] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:03:55.126320 1226 raft_consensus.cc:493] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:03:55.126485 1226 raft_consensus.cc:515] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:55.127017 1226 leader_election.cc:290] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a09f73250c946b38f9d50e9161aeca0 (127.29.190.193:37149), ea6a2cdd3dc547cd8b22c2de1ee337d9 (127.29.190.195:46433)
I20251211 21:03:55.130522 1023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88e9b66e61bc4c9e8eb98771ceca9b85" candidate_uuid: "4ab680f516534f8290e859c48d9d83b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a09f73250c946b38f9d50e9161aeca0" is_pre_election: true
I20251211 21:03:55.130522 1174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88e9b66e61bc4c9e8eb98771ceca9b85" candidate_uuid: "4ab680f516534f8290e859c48d9d83b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" is_pre_election: true
I20251211 21:03:55.130676 1023 raft_consensus.cc:2468] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab680f516534f8290e859c48d9d83b0 in term 0.
I20251211 21:03:55.130719 1174 raft_consensus.cc:2468] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab680f516534f8290e859c48d9d83b0 in term 0.
I20251211 21:03:55.130975 1065 leader_election.cc:304] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab680f516534f8290e859c48d9d83b0, 9a09f73250c946b38f9d50e9161aeca0; no voters:
I20251211 21:03:55.131150 1226 raft_consensus.cc:2804] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:03:55.131206 1226 raft_consensus.cc:493] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:03:55.131253 1226 raft_consensus.cc:3060] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:55.132112 1226 raft_consensus.cc:515] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:55.132431 1226 leader_election.cc:290] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [CANDIDATE]: Term 1 election: Requested vote from peers 9a09f73250c946b38f9d50e9161aeca0 (127.29.190.193:37149), ea6a2cdd3dc547cd8b22c2de1ee337d9 (127.29.190.195:46433)
I20251211 21:03:55.132718 1023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88e9b66e61bc4c9e8eb98771ceca9b85" candidate_uuid: "4ab680f516534f8290e859c48d9d83b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a09f73250c946b38f9d50e9161aeca0"
I20251211 21:03:55.132771 1174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88e9b66e61bc4c9e8eb98771ceca9b85" candidate_uuid: "4ab680f516534f8290e859c48d9d83b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9"
I20251211 21:03:55.132804 1023 raft_consensus.cc:3060] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:55.132927 1174 raft_consensus.cc:3060] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:03:55.133706 1023 raft_consensus.cc:2468] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab680f516534f8290e859c48d9d83b0 in term 1.
I20251211 21:03:55.133754 1174 raft_consensus.cc:2468] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab680f516534f8290e859c48d9d83b0 in term 1.
I20251211 21:03:55.133961 1065 leader_election.cc:304] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab680f516534f8290e859c48d9d83b0, 9a09f73250c946b38f9d50e9161aeca0; no voters:
I20251211 21:03:55.134106 1226 raft_consensus.cc:2804] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:03:55.134312 1226 raft_consensus.cc:697] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 1 LEADER]: Becoming Leader. State: Replica: 4ab680f516534f8290e859c48d9d83b0, State: Running, Role: LEADER
I20251211 21:03:55.134595 1226 consensus_queue.cc:237] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } }
I20251211 21:03:55.135953 920 catalog_manager.cc:5654] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ab680f516534f8290e859c48d9d83b0 (127.29.190.194). New cstate: current_term: 1 leader_uuid: "4ab680f516534f8290e859c48d9d83b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab680f516534f8290e859c48d9d83b0" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 } health_report { overall_health: UNKNOWN } } }
I20251211 21:03:55.542263 1226 consensus_queue.cc:1048] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a09f73250c946b38f9d50e9161aeca0" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:03:55.545336 1232 consensus_queue.cc:1048] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea6a2cdd3dc547cd8b22c2de1ee337d9" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 46433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:03:55.806363 974 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:55.806695 974 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:55.806764 974 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:55.806938 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:03:56.808753 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:03:57.807039 974 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:57.807339 974 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:57.807395 974 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:57.810308 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:03:58.811920 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:03:59.807705 974 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:03:59.807991 974 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:03:59.808043 974 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:03:59.813493 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:04:00.815078 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:04:01.808311 974 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:01.808591 974 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:01.808642 974 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:01.816663 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:04:02.818284 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:04:03.808895 974 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:03.809165 974 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:03.809216 974 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:03.820201 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:04:04.821790 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:04:05.809527 974 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:05.809813 974 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:05.809875 974 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:05.823369 968 placement_policy_util.cc:407] tablet 88e9b66e61bc4c9e8eb98771ceca9b85: detected majority of replicas (2 of 3) at location L0
I20251211 21:04:06.200740 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:04:06.204408 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:06.204617 30459 tablet_replica.cc:333] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0: stopping tablet replica
I20251211 21:04:06.204731 30459 raft_consensus.cc:2243] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:06.204843 30459 raft_consensus.cc:2272] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 9a09f73250c946b38f9d50e9161aeca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:06.217445 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:04:06.219664 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:04:06.223126 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:06.223327 30459 tablet_replica.cc:333] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0: stopping tablet replica
I20251211 21:04:06.223438 30459 raft_consensus.cc:2243] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:04:06.223678 30459 raft_consensus.cc:2272] T 88e9b66e61bc4c9e8eb98771ceca9b85 P 4ab680f516534f8290e859c48d9d83b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:06.236348 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:04:06.238189 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:04:06.241761 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:06.241961 30459 tablet_replica.cc:333] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9: stopping tablet replica
I20251211 21:04:06.242074 30459 raft_consensus.cc:2243] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:06.242188 30459 raft_consensus.cc:2272] T 88e9b66e61bc4c9e8eb98771ceca9b85 P ea6a2cdd3dc547cd8b22c2de1ee337d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:06.255257 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:04:06.257227 30459 master.cc:561] Master@127.29.190.254:34395 shutting down...
I20251211 21:04:06.260346 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:04:06.260502 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:06.260569 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P f6d9b8cfb51a407cb3c488eab219662b: stopping tablet replica
I20251211 21:04:06.272969 30459 master.cc:583] Master@127.29.190.254:34395 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy (12513 ms)
[ RUN ] AutoRebalancerTest.TestMaxMovesPerServer
I20251211 21:04:06.278651 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:45383
I20251211 21:04:06.278976 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:06.280635 1245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:06.280642 1244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:06.280690 30459 server_base.cc:1047] running on GCE node
W20251211 21:04:06.280871 1247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:06.281041 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:06.281090 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:06.281116 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487046281115 us; error 0 us; skew 500 ppm
I20251211 21:04:06.281883 30459 webserver.cc:492] Webserver started at http://127.29.190.254:39115/ using document root <none> and password file <none>
I20251211 21:04:06.282018 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:06.282065 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:06.282140 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:06.282513 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "07ec112d609342b2a41f60a6b9e38340"
format_stamp: "Formatted at 2025-12-11 21:04:06 on dist-test-slave-xjj2"
I20251211 21:04:06.283874 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:04:06.284729 1252 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.284936 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:06.284998 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "07ec112d609342b2a41f60a6b9e38340"
format_stamp: "Formatted at 2025-12-11 21:04:06 on dist-test-slave-xjj2"
I20251211 21:04:06.285066 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:06.304301 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:06.304693 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:06.308496 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:45383
I20251211 21:04:06.309974 1304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:45383 every 8 connection(s)
I20251211 21:04:06.310380 1305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:06.312283 1305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340: Bootstrap starting.
I20251211 21:04:06.313077 1305 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:06.314029 1305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340: No bootstrap required, opened a new log
I20251211 21:04:06.314399 1305 raft_consensus.cc:359] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ec112d609342b2a41f60a6b9e38340" member_type: VOTER }
I20251211 21:04:06.314486 1305 raft_consensus.cc:385] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:06.314515 1305 raft_consensus.cc:740] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07ec112d609342b2a41f60a6b9e38340, State: Initialized, Role: FOLLOWER
I20251211 21:04:06.314639 1305 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ec112d609342b2a41f60a6b9e38340" member_type: VOTER }
I20251211 21:04:06.314710 1305 raft_consensus.cc:399] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:04:06.314754 1305 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:04:06.314801 1305 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:06.315466 1305 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ec112d609342b2a41f60a6b9e38340" member_type: VOTER }
I20251211 21:04:06.315586 1305 leader_election.cc:304] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07ec112d609342b2a41f60a6b9e38340; no voters:
I20251211 21:04:06.315809 1305 leader_election.cc:290] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:04:06.315919 1308 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:06.316115 1308 raft_consensus.cc:697] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 1 LEADER]: Becoming Leader. State: Replica: 07ec112d609342b2a41f60a6b9e38340, State: Running, Role: LEADER
I20251211 21:04:06.316232 1305 sys_catalog.cc:565] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:04:06.316246 1308 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ec112d609342b2a41f60a6b9e38340" member_type: VOTER }
I20251211 21:04:06.316708 1309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07ec112d609342b2a41f60a6b9e38340" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ec112d609342b2a41f60a6b9e38340" member_type: VOTER } }
I20251211 21:04:06.316747 1310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07ec112d609342b2a41f60a6b9e38340. Latest consensus state: current_term: 1 leader_uuid: "07ec112d609342b2a41f60a6b9e38340" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ec112d609342b2a41f60a6b9e38340" member_type: VOTER } }
I20251211 21:04:06.316872 1310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [sys.catalog]: This master's current role is: LEADER
I20251211 21:04:06.317101 1315 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:04:06.317324 1309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [sys.catalog]: This master's current role is: LEADER
I20251211 21:04:06.317977 1315 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:04:06.318186 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:04:06.319707 1315 catalog_manager.cc:1357] Generated new cluster ID: c7c57d4a8f2e4e18b80fa52cc807b791
I20251211 21:04:06.319769 1315 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:04:06.326619 1315 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:04:06.327190 1315 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:04:06.334009 1315 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340: Generated new TSK 0
I20251211 21:04:06.334183 1315 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:04:06.350761 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:06.352545 1326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:06.352671 1329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:06.352784 1327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:06.352864 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:06.353046 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:06.353083 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:06.353103 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487046353102 us; error 0 us; skew 500 ppm
I20251211 21:04:06.353971 30459 webserver.cc:492] Webserver started at http://127.29.190.193:46809/ using document root <none> and password file <none>
I20251211 21:04:06.354137 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:06.354193 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:06.354269 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:06.354645 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
format_stamp: "Formatted at 2025-12-11 21:04:06 on dist-test-slave-xjj2"
I20251211 21:04:06.356066 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:04:06.356985 1334 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.357285 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:06.357353 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
format_stamp: "Formatted at 2025-12-11 21:04:06 on dist-test-slave-xjj2"
I20251211 21:04:06.357421 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:06.361129 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:06.361445 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:06.361683 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:06.362093 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:06.362145 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.362185 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:06.362210 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.366071 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:33469
I20251211 21:04:06.366103 1397 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:33469 every 8 connection(s)
I20251211 21:04:06.366879 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:06.368618 1402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:06.368723 1405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:06.368878 1403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:06.368937 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:06.369166 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:06.369220 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:06.369240 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487046369240 us; error 0 us; skew 500 ppm
I20251211 21:04:06.370131 30459 webserver.cc:492] Webserver started at http://127.29.190.194:34469/ using document root <none> and password file <none>
I20251211 21:04:06.370275 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:06.370321 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:06.370383 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:06.370786 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "22f0fcdd6d614884843d6ef3bca6708f"
format_stamp: "Formatted at 2025-12-11 21:04:06 on dist-test-slave-xjj2"
I20251211 21:04:06.371848 1398 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45383
I20251211 21:04:06.371953 1398 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:06.372210 1398 heartbeater.cc:507] Master 127.29.190.254:45383 requested a full tablet report, sending...
I20251211 21:04:06.372505 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:04:06.372853 1269 ts_manager.cc:194] Registered new tserver with Master: 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469)
I20251211 21:04:06.373528 1410 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.373765 1269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48332
I20251211 21:04:06.373798 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:06.373862 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "22f0fcdd6d614884843d6ef3bca6708f"
format_stamp: "Formatted at 2025-12-11 21:04:06 on dist-test-slave-xjj2"
I20251211 21:04:06.373930 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:06.397037 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:06.397485 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:06.397805 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:06.398350 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:06.398398 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.398445 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:06.398476 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.402741 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:34101
I20251211 21:04:06.402793 1473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:34101 every 8 connection(s)
I20251211 21:04:06.403623 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:06.405587 1477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:06.405601 1478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:06.405843 1480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:06.405936 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:06.406159 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:06.406216 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:06.406240 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487046406239 us; error 0 us; skew 500 ppm
I20251211 21:04:06.407363 30459 webserver.cc:492] Webserver started at http://127.29.190.195:46057/ using document root <none> and password file <none>
I20251211 21:04:06.407531 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:06.407593 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:06.407699 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:06.408008 1474 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45383
I20251211 21:04:06.408102 1474 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:06.408182 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "5eec57358d0f4ba48d683b4c7d445454"
format_stamp: "Formatted at 2025-12-11 21:04:06 on dist-test-slave-xjj2"
I20251211 21:04:06.408324 1474 heartbeater.cc:507] Master 127.29.190.254:45383 requested a full tablet report, sending...
I20251211 21:04:06.408952 1269 ts_manager.cc:194] Registered new tserver with Master: 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:06.409647 1269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48338
I20251211 21:04:06.410037 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20251211 21:04:06.411015 1485 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.411278 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:06.411339 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "5eec57358d0f4ba48d683b4c7d445454"
format_stamp: "Formatted at 2025-12-11 21:04:06 on dist-test-slave-xjj2"
I20251211 21:04:06.411402 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:06.433768 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:06.434206 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:06.434504 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:06.434967 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:06.435005 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.435038 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:06.435066 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:06.439431 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:45051
I20251211 21:04:06.439487 1548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:45051 every 8 connection(s)
I20251211 21:04:06.443714 1549 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45383
I20251211 21:04:06.443825 1549 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:06.444056 1549 heartbeater.cc:507] Master 127.29.190.254:45383 requested a full tablet report, sending...
I20251211 21:04:06.444638 1269 ts_manager.cc:194] Registered new tserver with Master: 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:06.445149 1269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48340
I20251211 21:04:06.445457 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005591679s
I20251211 21:04:07.374621 1398 heartbeater.cc:499] Master 127.29.190.254:45383 was elected leader, sending a full tablet report...
I20251211 21:04:07.410516 1474 heartbeater.cc:499] Master 127.29.190.254:45383 was elected leader, sending a full tablet report...
I20251211 21:04:07.445989 1549 heartbeater.cc:499] Master 127.29.190.254:45383 was elected leader, sending a full tablet report...
I20251211 21:04:07.471628 30459 test_util.cc:276] Using random seed: 2085745160
I20251211 21:04:07.479544 1269 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48354:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\252\252\252\n\004\001\000TUU\025\004\001\000\376\377\377\037\004\001\000\250\252\252*\004\001\000RUU5\004\001\000\374\377\377?\004\001\000\246\252\252J\004\001\000PUUU\004\001\000\372\377\377_\004\001\000\244\252\252j\004\001\000NUUu""\004\001\000\252\252\252\n\004\001\000TUU\025\004\001\000\376\377\377\037\004\001\000\250\252\252*\004\001\000RUU5\004\001\000\374\377\377?\004\001\000\246\252\252J\004\001\000PUUU\004\001\000\372\377\377_\004\001\000\244\252\252j\004\001\000NUUu"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:04:07.480225 1269 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:04:07.493971 1438 tablet_service.cc:1505] Processing CreateTablet for tablet 70e1f34692834e4cb9ffbdbbbc356141 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION VALUES < 178956970
I20251211 21:04:07.494236 1434 tablet_service.cc:1505] Processing CreateTablet for tablet 9afcbdf999514a22badd7550b63d8cb8 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 715827880 <= VALUES < 894784850
I20251211 21:04:07.494385 1438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e1f34692834e4cb9ffbdbbbc356141. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.494422 1432 tablet_service.cc:1505] Processing CreateTablet for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1252698790
I20251211 21:04:07.494522 1434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afcbdf999514a22badd7550b63d8cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.494635 1432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.496044 1435 tablet_service.cc:1505] Processing CreateTablet for tablet 91d55fcc7df346549c84ae6cfdcf36ad (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 715827880
I20251211 21:04:07.496290 1435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d55fcc7df346549c84ae6cfdcf36ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.494248 1433 tablet_service.cc:1505] Processing CreateTablet for tablet e90566476d56419683b3518348f96603 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 894784850 <= VALUES < 1073741820
I20251211 21:04:07.497321 1433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90566476d56419683b3518348f96603. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.497517 1512 tablet_service.cc:1505] Processing CreateTablet for tablet c94dc3e2fd5d4db3aa515604c847331f (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 178956970 <= VALUES < 357913940
I20251211 21:04:07.497766 1512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94dc3e2fd5d4db3aa515604c847331f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.498358 1436 tablet_service.cc:1505] Processing CreateTablet for tablet b5145c85694243d88e619a1c643c6909 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 357913940 <= VALUES < 536870910
I20251211 21:04:07.498574 1436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5145c85694243d88e619a1c643c6909. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.499823 1511 tablet_service.cc:1505] Processing CreateTablet for tablet b5145c85694243d88e619a1c643c6909 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 357913940 <= VALUES < 536870910
I20251211 21:04:07.500077 1511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5145c85694243d88e619a1c643c6909. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.500689 1361 tablet_service.cc:1505] Processing CreateTablet for tablet c94dc3e2fd5d4db3aa515604c847331f (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 178956970 <= VALUES < 357913940
I20251211 21:04:07.500808 1360 tablet_service.cc:1505] Processing CreateTablet for tablet b5145c85694243d88e619a1c643c6909 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 357913940 <= VALUES < 536870910
I20251211 21:04:07.500895 1358 tablet_service.cc:1505] Processing CreateTablet for tablet 9afcbdf999514a22badd7550b63d8cb8 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 715827880 <= VALUES < 894784850
I20251211 21:04:07.501125 1362 tablet_service.cc:1505] Processing CreateTablet for tablet 70e1f34692834e4cb9ffbdbbbc356141 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION VALUES < 178956970
I20251211 21:04:07.501142 1359 tablet_service.cc:1505] Processing CreateTablet for tablet 91d55fcc7df346549c84ae6cfdcf36ad (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 715827880
I20251211 21:04:07.501524 1356 tablet_service.cc:1505] Processing CreateTablet for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1252698790
I20251211 21:04:07.501340 1357 tablet_service.cc:1505] Processing CreateTablet for tablet e90566476d56419683b3518348f96603 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 894784850 <= VALUES < 1073741820
I20251211 21:04:07.500914 1361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94dc3e2fd5d4db3aa515604c847331f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.501794 1360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5145c85694243d88e619a1c643c6909. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.501966 1357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90566476d56419683b3518348f96603. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.502259 1510 tablet_service.cc:1505] Processing CreateTablet for tablet 91d55fcc7df346549c84ae6cfdcf36ad (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 715827880
I20251211 21:04:07.502480 1510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d55fcc7df346549c84ae6cfdcf36ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.503798 1359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d55fcc7df346549c84ae6cfdcf36ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.503921 1356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.504066 1509 tablet_service.cc:1505] Processing CreateTablet for tablet 9afcbdf999514a22badd7550b63d8cb8 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 715827880 <= VALUES < 894784850
I20251211 21:04:07.504172 1358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afcbdf999514a22badd7550b63d8cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.504297 1509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afcbdf999514a22badd7550b63d8cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.505825 1570 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.505959 1569 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.506209 1362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e1f34692834e4cb9ffbdbbbc356141. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.506255 1508 tablet_service.cc:1505] Processing CreateTablet for tablet e90566476d56419683b3518348f96603 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 894784850 <= VALUES < 1073741820
I20251211 21:04:07.506475 1508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90566476d56419683b3518348f96603. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.505825 1571 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.507886 1571 tablet_bootstrap.cc:654] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.508736 1507 tablet_service.cc:1505] Processing CreateTablet for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1252698790
I20251211 21:04:07.508893 1434 tablet_service.cc:1505] Processing CreateTablet for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1252698790 <= VALUES < 1431655760
I20251211 21:04:07.508970 1507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.509057 1358 tablet_service.cc:1505] Processing CreateTablet for tablet 77c000525583471e957c31b719d95ea0 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1431655760 <= VALUES < 1610612730
I20251211 21:04:07.509272 1358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c000525583471e957c31b719d95ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.509346 1436 tablet_service.cc:1505] Processing CreateTablet for tablet 77c000525583471e957c31b719d95ea0 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1431655760 <= VALUES < 1610612730
I20251211 21:04:07.509482 1359 tablet_service.cc:1505] Processing CreateTablet for tablet 605e369cbf1b4052b066b230cc165bb7 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1789569700 <= VALUES < 1968526670
I20251211 21:04:07.509688 1359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e369cbf1b4052b066b230cc165bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.509719 1433 tablet_service.cc:1505] Processing CreateTablet for tablet f04c059ecaa6400781a090ca30270262 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1789569700
I20251211 21:04:07.510114 1435 tablet_service.cc:1505] Processing CreateTablet for tablet 605e369cbf1b4052b066b230cc165bb7 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1789569700 <= VALUES < 1968526670
I20251211 21:04:07.510497 1432 tablet_service.cc:1505] Processing CreateTablet for tablet 9b336d873366440aa05f76b89a75710a (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1968526670 <= VALUES
I20251211 21:04:07.509126 1434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0e0cc37a5b41fd90c461aff17e8d28. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.497331 1513 tablet_service.cc:1505] Processing CreateTablet for tablet 70e1f34692834e4cb9ffbdbbbc356141 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION VALUES < 178956970
I20251211 21:04:07.511242 1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e1f34692834e4cb9ffbdbbbc356141. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.511291 1362 tablet_service.cc:1505] Processing CreateTablet for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1252698790 <= VALUES < 1431655760
I20251211 21:04:07.511504 1362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0e0cc37a5b41fd90c461aff17e8d28. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.506879 1569 tablet_bootstrap.cc:654] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.512974 1436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c000525583471e957c31b719d95ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.508893 1356 tablet_service.cc:1505] Processing CreateTablet for tablet f04c059ecaa6400781a090ca30270262 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1789569700
I20251211 21:04:07.513222 1356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04c059ecaa6400781a090ca30270262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.513439 1357 tablet_service.cc:1505] Processing CreateTablet for tablet 9b336d873366440aa05f76b89a75710a (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1968526670 <= VALUES
I20251211 21:04:07.513644 1357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b336d873366440aa05f76b89a75710a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.499835 1437 tablet_service.cc:1505] Processing CreateTablet for tablet c94dc3e2fd5d4db3aa515604c847331f (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 178956970 <= VALUES < 357913940
I20251211 21:04:07.514873 1432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b336d873366440aa05f76b89a75710a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.515028 1437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94dc3e2fd5d4db3aa515604c847331f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.515158 1435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e369cbf1b4052b066b230cc165bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.515275 1433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04c059ecaa6400781a090ca30270262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.515815 1513 tablet_service.cc:1505] Processing CreateTablet for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1252698790 <= VALUES < 1431655760
I20251211 21:04:07.516033 1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0e0cc37a5b41fd90c461aff17e8d28. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.518003 1510 tablet_service.cc:1505] Processing CreateTablet for tablet 605e369cbf1b4052b066b230cc165bb7 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1789569700 <= VALUES < 1968526670
I20251211 21:04:07.518266 1510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e369cbf1b4052b066b230cc165bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.519438 1508 tablet_service.cc:1505] Processing CreateTablet for tablet f04c059ecaa6400781a090ca30270262 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1789569700
I20251211 21:04:07.506879 1570 tablet_bootstrap.cc:654] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.519901 1508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04c059ecaa6400781a090ca30270262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.519981 1507 tablet_service.cc:1505] Processing CreateTablet for tablet 77c000525583471e957c31b719d95ea0 (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1431655760 <= VALUES < 1610612730
I20251211 21:04:07.520213 1507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c000525583471e957c31b719d95ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.519815 1509 tablet_service.cc:1505] Processing CreateTablet for tablet 9b336d873366440aa05f76b89a75710a (DEFAULT_TABLE table=test-workload [id=6a24d21be467491bbf840c8009ffc828]), partition=RANGE (key) PARTITION 1968526670 <= VALUES
I20251211 21:04:07.520829 1509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b336d873366440aa05f76b89a75710a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:07.521055 1570 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.521148 1570 ts_tablet_manager.cc:1403] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251211 21:04:07.521615 1570 raft_consensus.cc:359] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.521718 1570 raft_consensus.cc:385] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.521750 1570 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.521867 1570 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.522225 1570 ts_tablet_manager.cc:1434] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.522378 1570 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.523160 1569 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.523250 1569 ts_tablet_manager.cc:1403] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251211 21:04:07.523267 1571 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.523325 1571 ts_tablet_manager.cc:1403] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251211 21:04:07.523343 1570 tablet_bootstrap.cc:654] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.523728 1571 raft_consensus.cc:359] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.523821 1571 raft_consensus.cc:385] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.523851 1571 raft_consensus.cc:740] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.523978 1571 consensus_queue.cc:260] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.524299 1571 ts_tablet_manager.cc:1434] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.524459 1571 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.525281 1571 tablet_bootstrap.cc:654] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.525775 1570 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.525871 1570 ts_tablet_manager.cc:1403] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:04:07.525970 1569 raft_consensus.cc:359] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.526059 1569 raft_consensus.cc:385] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.526096 1569 raft_consensus.cc:740] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.526211 1569 consensus_queue.cc:260] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.526541 1569 ts_tablet_manager.cc:1434] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:04:07.526701 1570 raft_consensus.cc:359] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.526794 1570 raft_consensus.cc:385] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.526832 1570 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.526907 1571 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.526934 1570 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.527011 1571 ts_tablet_manager.cc:1403] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:04:07.527173 1570 ts_tablet_manager.cc:1434] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.527354 1570 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.527462 1571 raft_consensus.cc:359] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.527562 1571 raft_consensus.cc:385] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.527631 1571 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.527755 1571 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.527995 1571 ts_tablet_manager.cc:1434] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:07.528343 1570 tablet_bootstrap.cc:654] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.528469 1571 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.529448 1571 tablet_bootstrap.cc:654] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.529719 1569 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.530556 1571 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.530651 1571 ts_tablet_manager.cc:1403] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251211 21:04:07.530946 1569 tablet_bootstrap.cc:654] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.531044 1571 raft_consensus.cc:359] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.531141 1571 raft_consensus.cc:385] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.531181 1571 raft_consensus.cc:740] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.531307 1571 consensus_queue.cc:260] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.531545 1571 ts_tablet_manager.cc:1434] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.531786 1571 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.531883 1570 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.531953 1570 ts_tablet_manager.cc:1403] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251211 21:04:07.532274 1570 raft_consensus.cc:359] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.532382 1570 raft_consensus.cc:385] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.532415 1570 raft_consensus.cc:740] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.532845 1571 tablet_bootstrap.cc:654] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.532902 1570 consensus_queue.cc:260] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.532841 1569 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.533098 1569 ts_tablet_manager.cc:1403] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:04:07.533411 1569 raft_consensus.cc:359] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.533493 1569 raft_consensus.cc:385] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.533532 1569 raft_consensus.cc:740] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.533636 1569 consensus_queue.cc:260] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.533973 1569 ts_tablet_manager.cc:1434] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.534160 1571 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.534265 1571 ts_tablet_manager.cc:1403] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:04:07.534752 1571 raft_consensus.cc:359] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.534884 1571 raft_consensus.cc:385] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.534924 1571 raft_consensus.cc:740] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.535064 1569 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.535049 1571 consensus_queue.cc:260] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.535414 1571 ts_tablet_manager.cc:1434] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.535681 1571 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.535817 1570 ts_tablet_manager.cc:1434] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251211 21:04:07.536072 1569 tablet_bootstrap.cc:654] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.536401 1570 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.536720 1571 tablet_bootstrap.cc:654] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.537359 1570 tablet_bootstrap.cc:654] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.537909 1571 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.538012 1571 ts_tablet_manager.cc:1403] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:04:07.538331 1570 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.538407 1570 ts_tablet_manager.cc:1403] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:04:07.538465 1571 raft_consensus.cc:359] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.538586 1571 raft_consensus.cc:385] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.538630 1571 raft_consensus.cc:740] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.538744 1571 consensus_queue.cc:260] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.538769 1570 raft_consensus.cc:359] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.538895 1570 raft_consensus.cc:385] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.538945 1570 raft_consensus.cc:740] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.539060 1570 consensus_queue.cc:260] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.539126 1571 ts_tablet_manager.cc:1434] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:07.539323 1571 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.539595 1570 ts_tablet_manager.cc:1434] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.539788 1570 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.540376 1571 tablet_bootstrap.cc:654] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.540736 1570 tablet_bootstrap.cc:654] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.541575 1571 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.541690 1571 ts_tablet_manager.cc:1403] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:07.542171 1571 raft_consensus.cc:359] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.542297 1571 raft_consensus.cc:385] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.542346 1571 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.542484 1571 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.542770 1571 ts_tablet_manager.cc:1434] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.542979 1571 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.543083 1570 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.543169 1570 ts_tablet_manager.cc:1403] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:04:07.543237 1569 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.543330 1569 ts_tablet_manager.cc:1403] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251211 21:04:07.543542 1570 raft_consensus.cc:359] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.543661 1570 raft_consensus.cc:385] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.543695 1570 raft_consensus.cc:740] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.543792 1569 raft_consensus.cc:359] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.543825 1570 consensus_queue.cc:260] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.543896 1569 raft_consensus.cc:385] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.543934 1569 raft_consensus.cc:740] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.544049 1571 tablet_bootstrap.cc:654] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.544094 1569 consensus_queue.cc:260] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.544358 1569 ts_tablet_manager.cc:1434] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:07.544848 1569 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.545384 1570 ts_tablet_manager.cc:1434] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:04:07.545579 1570 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.545863 1569 tablet_bootstrap.cc:654] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.546510 1570 tablet_bootstrap.cc:654] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.547331 1569 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.547405 1569 ts_tablet_manager.cc:1403] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251211 21:04:07.547647 1570 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.547739 1570 ts_tablet_manager.cc:1403] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:07.547953 1569 raft_consensus.cc:359] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.548069 1569 raft_consensus.cc:385] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.548110 1569 raft_consensus.cc:740] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.548148 1570 raft_consensus.cc:359] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.548249 1570 raft_consensus.cc:385] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.548223 1569 consensus_queue.cc:260] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.548285 1570 raft_consensus.cc:740] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.548300 1571 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.548367 1571 ts_tablet_manager.cc:1403] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251211 21:04:07.548388 1570 consensus_queue.cc:260] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.548719 1570 ts_tablet_manager.cc:1434] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.548756 1571 raft_consensus.cc:359] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.548854 1571 raft_consensus.cc:385] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.548887 1571 raft_consensus.cc:740] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.548889 1570 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.549006 1571 consensus_queue.cc:260] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.549288 1571 ts_tablet_manager.cc:1434] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:07.549496 1571 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.549924 1570 tablet_bootstrap.cc:654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.550444 1571 tablet_bootstrap.cc:654] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.550990 1570 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.551079 1570 ts_tablet_manager.cc:1403] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:07.551453 1571 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.551535 1571 ts_tablet_manager.cc:1403] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:04:07.551517 1570 raft_consensus.cc:359] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.551664 1570 raft_consensus.cc:385] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.551704 1570 raft_consensus.cc:740] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.551824 1570 consensus_queue.cc:260] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.551995 1571 raft_consensus.cc:359] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.552129 1571 raft_consensus.cc:385] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.552173 1571 raft_consensus.cc:740] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.552284 1571 consensus_queue.cc:260] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.552058 1570 ts_tablet_manager.cc:1434] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.552542 1571 ts_tablet_manager.cc:1434] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:07.552556 1570 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.552769 1571 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.553601 1570 tablet_bootstrap.cc:654] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.553743 1571 tablet_bootstrap.cc:654] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.554821 1570 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.554908 1570 ts_tablet_manager.cc:1403] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:07.555030 1569 ts_tablet_manager.cc:1434] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20251211 21:04:07.555222 1569 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.555327 1570 raft_consensus.cc:359] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.555430 1570 raft_consensus.cc:385] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.555469 1570 raft_consensus.cc:740] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.555594 1570 consensus_queue.cc:260] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.555886 1570 ts_tablet_manager.cc:1434] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:07.556047 1570 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.556197 1569 tablet_bootstrap.cc:654] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.556948 1570 tablet_bootstrap.cc:654] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.557301 1569 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.557392 1569 ts_tablet_manager.cc:1403] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:04:07.557792 1569 raft_consensus.cc:359] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.557921 1569 raft_consensus.cc:385] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.557955 1569 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.558009 1570 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.558096 1570 ts_tablet_manager.cc:1403] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:04:07.558139 1569 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.558537 1570 raft_consensus.cc:359] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.558637 1570 raft_consensus.cc:385] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.558666 1570 raft_consensus.cc:740] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.558722 1571 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.558797 1571 ts_tablet_manager.cc:1403] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251211 21:04:07.558791 1570 consensus_queue.cc:260] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.559047 1570 ts_tablet_manager.cc:1434] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.559218 1570 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.559245 1571 raft_consensus.cc:359] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.559341 1571 raft_consensus.cc:385] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.559383 1571 raft_consensus.cc:740] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.559494 1571 consensus_queue.cc:260] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.559762 1571 ts_tablet_manager.cc:1434] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.559933 1571 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.560022 1569 ts_tablet_manager.cc:1434] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251211 21:04:07.560185 1570 tablet_bootstrap.cc:654] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.560835 1571 tablet_bootstrap.cc:654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.561118 1569 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.562031 1569 tablet_bootstrap.cc:654] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.562382 1571 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.562454 1571 ts_tablet_manager.cc:1403] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:04:07.562848 1571 raft_consensus.cc:359] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.562950 1571 raft_consensus.cc:385] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.562991 1571 raft_consensus.cc:740] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.563091 1569 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.563112 1571 consensus_queue.cc:260] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.563169 1569 ts_tablet_manager.cc:1403] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251211 21:04:07.563361 1571 ts_tablet_manager.cc:1434] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:07.563545 1569 raft_consensus.cc:359] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.563660 1569 raft_consensus.cc:385] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.563691 1569 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.563723 1571 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.563794 1569 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.564070 1569 ts_tablet_manager.cc:1434] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.564247 1569 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.564626 1571 tablet_bootstrap.cc:654] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.565188 1569 tablet_bootstrap.cc:654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.565687 1571 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.565766 1571 ts_tablet_manager.cc:1403] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:07.566092 1571 raft_consensus.cc:359] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.566167 1571 raft_consensus.cc:385] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.566196 1571 raft_consensus.cc:740] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.566299 1571 consensus_queue.cc:260] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.566349 1569 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.566411 1569 ts_tablet_manager.cc:1403] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:04:07.566553 1571 ts_tablet_manager.cc:1434] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:07.567412 1570 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.566798 1569 raft_consensus.cc:359] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.567476 1569 raft_consensus.cc:385] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.567497 1570 ts_tablet_manager.cc:1403] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251211 21:04:07.567534 1569 raft_consensus.cc:740] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.567695 1569 consensus_queue.cc:260] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.567746 1571 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: Bootstrap starting.
I20251211 21:04:07.567922 1570 raft_consensus.cc:359] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.568017 1570 raft_consensus.cc:385] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.568051 1570 raft_consensus.cc:740] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.568162 1570 consensus_queue.cc:260] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.568452 1570 ts_tablet_manager.cc:1434] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.568629 1570 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.568809 1569 ts_tablet_manager.cc:1434] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:04:07.568977 1569 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.569209 1571 tablet_bootstrap.cc:654] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.569515 1570 tablet_bootstrap.cc:654] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.570246 1571 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: No bootstrap required, opened a new log
I20251211 21:04:07.570324 1571 ts_tablet_manager.cc:1403] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:04:07.570514 1569 tablet_bootstrap.cc:654] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.570720 1571 raft_consensus.cc:359] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.570812 1571 raft_consensus.cc:385] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.570847 1571 raft_consensus.cc:740] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.570958 1571 consensus_queue.cc:260] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.571270 1571 ts_tablet_manager.cc:1434] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.571746 1570 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.571841 1570 ts_tablet_manager.cc:1403] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:04:07.571859 1569 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.571990 1569 ts_tablet_manager.cc:1403] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:04:07.572270 1570 raft_consensus.cc:359] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.572373 1570 raft_consensus.cc:385] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.572350 1569 raft_consensus.cc:359] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.572412 1570 raft_consensus.cc:740] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.572422 1569 raft_consensus.cc:385] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.572458 1569 raft_consensus.cc:740] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.572540 1570 consensus_queue.cc:260] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.572549 1569 consensus_queue.cc:260] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.572850 1569 ts_tablet_manager.cc:1434] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:07.573006 1569 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.573424 1570 ts_tablet_manager.cc:1434] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251211 21:04:07.573594 1570 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454: Bootstrap starting.
I20251211 21:04:07.573938 1569 tablet_bootstrap.cc:654] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.575026 1570 tablet_bootstrap.cc:654] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.576047 1570 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454: No bootstrap required, opened a new log
I20251211 21:04:07.576072 1569 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.576129 1570 ts_tablet_manager.cc:1403] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20251211 21:04:07.576138 1569 ts_tablet_manager.cc:1403] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251211 21:04:07.576524 1570 raft_consensus.cc:359] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.576545 1569 raft_consensus.cc:359] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.576610 1570 raft_consensus.cc:385] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.576620 1569 raft_consensus.cc:385] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.576661 1570 raft_consensus.cc:740] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.576666 1569 raft_consensus.cc:740] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.576785 1569 consensus_queue.cc:260] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.576787 1570 consensus_queue.cc:260] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.577015 1569 ts_tablet_manager.cc:1434] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:07.577111 1570 ts_tablet_manager.cc:1434] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.577170 1569 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.578142 1569 tablet_bootstrap.cc:654] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.579133 1577 raft_consensus.cc:493] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.579187 1569 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.579264 1569 ts_tablet_manager.cc:1403] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251211 21:04:07.579228 1577 raft_consensus.cc:515] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.579713 1577 leader_election.cc:290] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.579695 1569 raft_consensus.cc:359] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.579831 1569 raft_consensus.cc:385] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.579865 1569 raft_consensus.cc:740] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.579984 1569 consensus_queue.cc:260] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.580265 1569 ts_tablet_manager.cc:1434] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.580425 1569 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.581435 1569 tablet_bootstrap.cc:654] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.582707 1569 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.582800 1569 ts_tablet_manager.cc:1403] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:07.583228 1569 raft_consensus.cc:359] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.583333 1569 raft_consensus.cc:385] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.583379 1569 raft_consensus.cc:740] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.583487 1569 consensus_queue.cc:260] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.583774 1569 ts_tablet_manager.cc:1434] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.583787 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77c000525583471e957c31b719d95ea0" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f" is_pre_election: true
I20251211 21:04:07.583942 1448 raft_consensus.cc:2468] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.583995 1569 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: Bootstrap starting.
I20251211 21:04:07.584400 1335 leader_election.cc:304] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.584563 1577 raft_consensus.cc:2804] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.584609 1577 raft_consensus.cc:493] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.584642 1577 raft_consensus.cc:3060] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.584952 1569 tablet_bootstrap.cc:654] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:07.585549 1577 raft_consensus.cc:515] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.585924 1577 leader_election.cc:290] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.585992 1523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77c000525583471e957c31b719d95ea0" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.586112 1523 raft_consensus.cc:2468] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.586225 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77c000525583471e957c31b719d95ea0" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:07.586277 1569 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: No bootstrap required, opened a new log
I20251211 21:04:07.586321 1448 raft_consensus.cc:3060] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.586347 1569 ts_tablet_manager.cc:1403] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:07.586396 1523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77c000525583471e957c31b719d95ea0" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.586479 1523 raft_consensus.cc:3060] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.586767 1569 raft_consensus.cc:359] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.586850 1569 raft_consensus.cc:385] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:07.586879 1569 raft_consensus.cc:740] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Initialized, Role: FOLLOWER
I20251211 21:04:07.587002 1569 consensus_queue.cc:260] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.587304 1448 raft_consensus.cc:2468] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.587327 1569 ts_tablet_manager.cc:1434] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:07.587698 1335 leader_election.cc:304] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.587741 1523 raft_consensus.cc:2468] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.587877 1577 raft_consensus.cc:2804] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.588085 1577 raft_consensus.cc:697] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:07.588222 1577 consensus_queue.cc:237] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.589586 1267 catalog_manager.cc:5654] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.599936 1579 raft_consensus.cc:493] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.600121 1579 raft_consensus.cc:515] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.600710 1579 leader_election.cc:290] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.604504 1523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c94dc3e2fd5d4db3aa515604c847331f" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.604645 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c94dc3e2fd5d4db3aa515604c847331f" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" is_pre_election: true
I20251211 21:04:07.604674 1523 raft_consensus.cc:2468] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 0.
I20251211 21:04:07.604808 1371 raft_consensus.cc:2468] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 0.
I20251211 21:04:07.604966 1575 raft_consensus.cc:493] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.605052 1575 raft_consensus.cc:515] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.605059 1413 leader_election.cc:304] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.605298 1579 raft_consensus.cc:2804] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.605355 1579 raft_consensus.cc:493] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.605401 1579 raft_consensus.cc:3060] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.605540 1575 leader_election.cc:290] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:07.606338 1579 raft_consensus.cc:515] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.606691 1579 leader_election.cc:290] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.606941 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c94dc3e2fd5d4db3aa515604c847331f" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:07.607052 1371 raft_consensus.cc:3060] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.607882 1371 raft_consensus.cc:2468] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 1.
I20251211 21:04:07.608163 1411 leader_election.cc:304] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.608194 1523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c94dc3e2fd5d4db3aa515604c847331f" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.608286 1523 raft_consensus.cc:3060] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.608378 1579 raft_consensus.cc:2804] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.608458 1579 raft_consensus.cc:697] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:07.608577 1579 consensus_queue.cc:237] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.609205 1523 raft_consensus.cc:2468] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 1.
I20251211 21:04:07.610361 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e90566476d56419683b3518348f96603" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f" is_pre_election: true
I20251211 21:04:07.610446 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e90566476d56419683b3518348f96603" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" is_pre_election: true
I20251211 21:04:07.610482 1448 raft_consensus.cc:2468] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 0.
I20251211 21:04:07.610412 1267 catalog_manager.cc:5654] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.610520 1371 raft_consensus.cc:2468] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 0.
I20251211 21:04:07.610775 1486 leader_election.cc:304] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.610924 1575 raft_consensus.cc:2804] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.610972 1575 raft_consensus.cc:493] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.611009 1575 raft_consensus.cc:3060] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.611755 1575 raft_consensus.cc:515] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.612057 1575 leader_election.cc:290] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:07.612411 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e90566476d56419683b3518348f96603" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:07.612493 1371 raft_consensus.cc:3060] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.612509 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e90566476d56419683b3518348f96603" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:07.612597 1448 raft_consensus.cc:3060] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.613132 1371 raft_consensus.cc:2468] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 1.
I20251211 21:04:07.613271 1448 raft_consensus.cc:2468] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 1.
I20251211 21:04:07.613348 1486 leader_election.cc:304] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.613477 1575 raft_consensus.cc:2804] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.613569 1584 raft_consensus.cc:493] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.613660 1584 raft_consensus.cc:515] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.613678 1575 raft_consensus.cc:697] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Becoming Leader. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:07.613807 1575 consensus_queue.cc:237] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.613996 1584 leader_election.cc:290] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.614436 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70e1f34692834e4cb9ffbdbbbc356141" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" is_pre_election: true
I20251211 21:04:07.614506 1523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70e1f34692834e4cb9ffbdbbbc356141" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.614535 1371 raft_consensus.cc:2468] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 0.
I20251211 21:04:07.614574 1523 raft_consensus.cc:2468] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 0.
I20251211 21:04:07.614775 1411 leader_election.cc:304] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.614984 1584 raft_consensus.cc:2804] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.615042 1584 raft_consensus.cc:493] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.615088 1584 raft_consensus.cc:3060] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.615317 1267 catalog_manager.cc:5654] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } }
I20251211 21:04:07.615995 1577 raft_consensus.cc:493] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.616081 1577 raft_consensus.cc:515] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.616189 1584 raft_consensus.cc:515] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.616394 1577 leader_election.cc:290] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.616519 1584 leader_election.cc:290] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.616748 1523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3164db1c791a4cd7b4f9057f5f5e0cd9" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.616767 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70e1f34692834e4cb9ffbdbbbc356141" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.616811 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3164db1c791a4cd7b4f9057f5f5e0cd9" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f" is_pre_election: true
I20251211 21:04:07.616909 1448 raft_consensus.cc:2468] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.616888 1522 raft_consensus.cc:3060] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.616882 1523 raft_consensus.cc:2468] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.617153 1335 leader_election.cc:304] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.617383 1577 raft_consensus.cc:2804] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.617439 1577 raft_consensus.cc:493] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.617483 1577 raft_consensus.cc:3060] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.617852 1522 raft_consensus.cc:2468] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 1.
I20251211 21:04:07.618116 1413 leader_election.cc:304] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.618256 1584 raft_consensus.cc:2804] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.618321 1584 raft_consensus.cc:697] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:07.618405 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70e1f34692834e4cb9ffbdbbbc356141" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:07.618295 1577 raft_consensus.cc:515] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.618450 1584 consensus_queue.cc:237] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.618492 1371 raft_consensus.cc:3060] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.618732 1577 leader_election.cc:290] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.619073 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3164db1c791a4cd7b4f9057f5f5e0cd9" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.619172 1522 raft_consensus.cc:3060] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.619371 1371 raft_consensus.cc:2468] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 1.
I20251211 21:04:07.619668 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3164db1c791a4cd7b4f9057f5f5e0cd9" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:07.619756 1448 raft_consensus.cc:3060] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.619967 1522 raft_consensus.cc:2468] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.620009 1267 catalog_manager.cc:5654] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.620292 1337 leader_election.cc:304] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.620453 1577 raft_consensus.cc:2804] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.620492 1448 raft_consensus.cc:2468] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.620530 1577 raft_consensus.cc:697] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:07.620630 1577 consensus_queue.cc:237] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.622215 1268 catalog_manager.cc:5654] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.632302 1575 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.632445 1575 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.632863 1575 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:07.633337 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" is_pre_election: true
I20251211 21:04:07.633337 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f" is_pre_election: true
I20251211 21:04:07.633526 1371 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 0.
I20251211 21:04:07.633526 1448 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 0.
I20251211 21:04:07.633829 1486 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.633996 1575 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.634057 1575 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.634101 1575 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.634979 1575 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.635306 1575 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:07.635763 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:07.635763 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:07.635905 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.635905 1448 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.636881 1371 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 1.
I20251211 21:04:07.636881 1448 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 1.
I20251211 21:04:07.637200 1486 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.637364 1575 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.637454 1575 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Becoming Leader. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:07.637588 1575 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.639434 1268 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } }
I20251211 21:04:07.642351 1579 raft_consensus.cc:493] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.642434 1579 raft_consensus.cc:515] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.642737 1579 leader_election.cc:290] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.643038 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e0e0cc37a5b41fd90c461aff17e8d28" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.643038 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e0e0cc37a5b41fd90c461aff17e8d28" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" is_pre_election: true
I20251211 21:04:07.643177 1522 raft_consensus.cc:2468] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 0.
I20251211 21:04:07.643184 1371 raft_consensus.cc:2468] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 0.
I20251211 21:04:07.643432 1413 leader_election.cc:304] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.643589 1579 raft_consensus.cc:2804] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.643676 1579 raft_consensus.cc:493] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.643713 1579 raft_consensus.cc:3060] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.644465 1579 raft_consensus.cc:515] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.644734 1579 leader_election.cc:290] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.645016 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e0e0cc37a5b41fd90c461aff17e8d28" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:07.645103 1371 raft_consensus.cc:3060] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.645062 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e0e0cc37a5b41fd90c461aff17e8d28" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.645182 1522 raft_consensus.cc:3060] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.645780 1371 raft_consensus.cc:2468] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 1.
I20251211 21:04:07.645890 1522 raft_consensus.cc:2468] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 1.
I20251211 21:04:07.646003 1411 leader_election.cc:304] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.646176 1579 raft_consensus.cc:2804] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.646256 1579 raft_consensus.cc:697] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:07.646382 1579 consensus_queue.cc:237] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.647861 1268 catalog_manager.cc:5654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.648138 1577 raft_consensus.cc:493] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.648219 1577 raft_consensus.cc:515] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.648548 1577 leader_election.cc:290] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.648798 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.648798 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f" is_pre_election: true
I20251211 21:04:07.648919 1522 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.648919 1448 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.649192 1335 leader_election.cc:304] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.649369 1577 raft_consensus.cc:2804] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.649435 1577 raft_consensus.cc:493] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.649475 1577 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.650279 1577 raft_consensus.cc:515] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.650542 1577 leader_election.cc:290] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.650820 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:07.650847 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.650949 1448 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.650966 1522 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.651914 1522 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.651914 1448 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.652237 1335 leader_election.cc:304] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.652456 1577 raft_consensus.cc:2804] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.652534 1577 raft_consensus.cc:697] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:07.652653 1577 consensus_queue.cc:237] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.654237 1268 catalog_manager.cc:5654] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.685487 1621 raft_consensus.cc:493] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.685650 1621 raft_consensus.cc:515] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.686105 1621 leader_election.cc:290] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:07.686542 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" is_pre_election: true
I20251211 21:04:07.686538 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f" is_pre_election: true
I20251211 21:04:07.686694 1371 raft_consensus.cc:2468] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 0.
I20251211 21:04:07.686712 1448 raft_consensus.cc:2468] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 0.
I20251211 21:04:07.686985 1486 leader_election.cc:304] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.687141 1621 raft_consensus.cc:2804] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.687211 1621 raft_consensus.cc:493] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.687252 1621 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.688130 1621 raft_consensus.cc:515] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.688447 1621 leader_election.cc:290] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:07.688902 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:07.689010 1448 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.689170 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:07.689260 1371 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.689776 1448 raft_consensus.cc:2468] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 1.
I20251211 21:04:07.689913 1371 raft_consensus.cc:2468] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 1.
I20251211 21:04:07.690080 1486 leader_election.cc:304] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.690224 1621 raft_consensus.cc:2804] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.690323 1621 raft_consensus.cc:697] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Becoming Leader. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:07.690454 1621 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.692152 1268 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } }
I20251211 21:04:07.707302 1579 raft_consensus.cc:493] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.707458 1579 raft_consensus.cc:515] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.707914 1579 leader_election.cc:290] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.708353 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" is_pre_election: true
I20251211 21:04:07.708384 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.708468 1371 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 0.
I20251211 21:04:07.708514 1522 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 0.
I20251211 21:04:07.708731 1411 leader_election.cc:304] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.708899 1579 raft_consensus.cc:2804] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.708966 1579 raft_consensus.cc:493] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.708994 1579 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.709743 1579 raft_consensus.cc:515] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.710067 1579 leader_election.cc:290] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.710417 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.710426 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:07.710561 1371 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.710561 1522 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.711519 1522 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 1.
I20251211 21:04:07.711519 1371 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 1.
I20251211 21:04:07.711939 1411 leader_election.cc:304] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.712109 1579 raft_consensus.cc:2804] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.712205 1579 raft_consensus.cc:697] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:07.712342 1579 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.713914 1268 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.783310 1577 raft_consensus.cc:493] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.783466 1577 raft_consensus.cc:515] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.783910 1577 leader_election.cc:290] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.784353 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.784354 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f" is_pre_election: true
I20251211 21:04:07.784490 1522 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.784528 1448 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.784773 1335 leader_election.cc:304] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.784931 1577 raft_consensus.cc:2804] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.784989 1577 raft_consensus.cc:493] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.785035 1577 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.785825 1577 raft_consensus.cc:515] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.786190 1577 leader_election.cc:290] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.786520 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.786614 1522 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.787314 1522 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.787526 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:07.787569 1337 leader_election.cc:304] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.787652 1448 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.787742 1577 raft_consensus.cc:2804] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.787832 1577 raft_consensus.cc:697] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:07.787966 1577 consensus_queue.cc:237] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.788374 1448 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.789619 1268 catalog_manager.cc:5654] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.939844 1614 raft_consensus.cc:493] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:07.940011 1614 raft_consensus.cc:515] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.940457 1614 leader_election.cc:290] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.940918 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454" is_pre_election: true
I20251211 21:04:07.940922 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f" is_pre_election: true
I20251211 21:04:07.941067 1522 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.941093 1448 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 0.
I20251211 21:04:07.941325 1337 leader_election.cc:304] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:07.941486 1614 raft_consensus.cc:2804] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:07.941540 1614 raft_consensus.cc:493] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:07.941591 1614 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.942569 1614 raft_consensus.cc:515] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.942891 1614 leader_election.cc:290] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:07.943220 1522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:07.943230 1448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:07.943322 1522 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.943331 1448 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:07.944077 1448 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.944078 1522 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 1.
I20251211 21:04:07.944351 1335 leader_election.cc:304] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:07.944504 1614 raft_consensus.cc:2804] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:07.944612 1614 raft_consensus.cc:697] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:07.944746 1614 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:07.946281 1268 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:07.983906 1614 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.990520 1522 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.990932 1614 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.991037 1522 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.993688 1577 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.994446 1447 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.994760 1446 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.995023 1371 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.995469 1577 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.995483 1523 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.995712 1371 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.996061 1584 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.996304 1584 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.997346 1522 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.997798 1522 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:07.998284 1577 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.998497 1614 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.998296 1579 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251211 21:04:07.999647 1579 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:07.999861 1579 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.000535 1522 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.002911 1370 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.003165 1519 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.003332 1445 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.003823 1614 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.004990 1584 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.005283 1577 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.007282 1579 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.013077 1444 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.013077 1515 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.013597 1577 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.014772 1614 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.016011 1575 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.017242 1372 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:04:08.017736 1579 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.031033 1658 mvcc.cc:204] Tried to move back new op lower bound from 7231434948586684416 to 7231434947160846336. Current Snapshot: MvccSnapshot[applied={T|T < 7231434948586684416 or (T in {7231434948586684416})}]
I20251211 21:04:08.032104 1448 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.032424 1575 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.045765 1372 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.046092 1447 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.046723 1621 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.047020 1621 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.048538 1445 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.048877 1575 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.062142 1648 mvcc.cc:204] Tried to move back new op lower bound from 7231434948843732992 to 7231434947006283776. Current Snapshot: MvccSnapshot[applied={T|T < 7231434948843732992 or (T in {7231434948843732992})}]
I20251211 21:04:08.062638 1371 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:08.063150 1621 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:08.320506 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:08.345019 1372 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3164db1c791a4cd7b4f9057f5f5e0cd9"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "5eec57358d0f4ba48d683b4c7d445454"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:08.345186 1372 raft_consensus.cc:606] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Received request to transfer leadership to TS 5eec57358d0f4ba48d683b4c7d445454
I20251211 21:04:08.347534 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:08.347695 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251211 21:04:08.351732 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.376066 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.387207 1346 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.399994 1346 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.419483 1346 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.425315 1346 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.426762 1346 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.427453 1346 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.432850 1346 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.432914 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.433627 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.435492 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.440383 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.441100 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.441737 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.442415 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.447340 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.450382 1346 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.450382 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.450453 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.453508 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.456482 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.456554 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.460371 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.465385 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.467355 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.467429 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.468217 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.474287 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.476169 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.478065 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.478158 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.484084 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.487099 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.489964 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.491875 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.499092 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.499102 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.502163 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.504109 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.512382 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.513269 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.514035 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.515942 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.525156 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.526033 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.528924 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.532794 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.539877 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.539947 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.544045 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.550204 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.557554 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.558596 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.562659 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.566783 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.572996 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.573848 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.582033 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.582082 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.591364 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.591398 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.601785 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.602689 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.610867 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.612876 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.623173 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.624156 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.629279 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.633371 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.642735 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.642735 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.653191 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.653198 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.662566 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.663482 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.674862 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.675812 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.685086 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.688222 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.697381 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.698268 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.709685 1343 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.709677 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.721189 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.724303 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
W20251211 21:04:08.733500 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
I20251211 21:04:08.735883 1720 raft_consensus.cc:993] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 5eec57358d0f4ba48d683b4c7d445454 to start an election
I20251211 21:04:08.735981 1720 raft_consensus.cc:1081] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Signalling peer 5eec57358d0f4ba48d683b4c7d445454 to start an election
I20251211 21:04:08.736356 1518 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3164db1c791a4cd7b4f9057f5f5e0cd9"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
from {username='slave'} at 127.0.0.1:56258
I20251211 21:04:08.736487 1518 raft_consensus.cc:493] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20251211 21:04:08.736514 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Service unavailable: leader transfer in progress
I20251211 21:04:08.736557 1518 raft_consensus.cc:3060] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:08.737442 1518 raft_consensus.cc:515] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:08.737740 1518 leader_election.cc:290] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 2 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:08.738013 1370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3164db1c791a4cd7b4f9057f5f5e0cd9" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:08.738068 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3164db1c791a4cd7b4f9057f5f5e0cd9" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:08.738178 1370 raft_consensus.cc:3055] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:08.738191 1445 raft_consensus.cc:3060] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:08.738233 1370 raft_consensus.cc:740] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:08.738366 1370 consensus_queue.cc:260] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 18, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:08.738512 1370 raft_consensus.cc:3060] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:08.739044 1445 raft_consensus.cc:2468] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 2.
I20251211 21:04:08.739324 1370 raft_consensus.cc:2468] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 2.
I20251211 21:04:08.739343 1486 leader_election.cc:304] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:08.739480 1575 raft_consensus.cc:2804] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:08.739567 1575 raft_consensus.cc:697] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 LEADER]: Becoming Leader. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:08.739709 1575 consensus_queue.cc:237] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 18, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:08.741185 1262 catalog_manager.cc:5654] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: term changed from 1 to 2, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195). New cstate: current_term: 2 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } }
W20251211 21:04:08.747462 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Illegal state: replica 2d3e56eb6a174c3eb932f4bcdc62e18c is not leader of this config: current role FOLLOWER
W20251211 21:04:08.748437 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Illegal state: replica 2d3e56eb6a174c3eb932f4bcdc62e18c is not leader of this config: current role FOLLOWER
W20251211 21:04:08.760625 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Illegal state: replica 2d3e56eb6a174c3eb932f4bcdc62e18c is not leader of this config: current role FOLLOWER
W20251211 21:04:08.762719 1347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40798: Illegal state: replica 2d3e56eb6a174c3eb932f4bcdc62e18c is not leader of this config: current role FOLLOWER
W20251211 21:04:08.773270 1428 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58086: Illegal state: replica 22f0fcdd6d614884843d6ef3bca6708f is not leader of this config: current role FOLLOWER
W20251211 21:04:08.775344 1428 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58086: Illegal state: replica 22f0fcdd6d614884843d6ef3bca6708f is not leader of this config: current role FOLLOWER
W20251211 21:04:08.787729 1428 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58086: Illegal state: replica 22f0fcdd6d614884843d6ef3bca6708f is not leader of this config: current role FOLLOWER
W20251211 21:04:08.788882 1428 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58086: Illegal state: replica 22f0fcdd6d614884843d6ef3bca6708f is not leader of this config: current role FOLLOWER
I20251211 21:04:08.800204 1445 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 2 index: 20. (index mismatch)
I20251211 21:04:08.800204 1370 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 2 index: 20. (index mismatch)
I20251211 21:04:08.800593 1621 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20251211 21:04:08.800734 1575 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20251211 21:04:08.874033 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:08.876626 1729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:08.877077 1730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:08.877630 1732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:08.879243 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:08.879436 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:08.879474 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:08.879493 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487048879493 us; error 0 us; skew 500 ppm
I20251211 21:04:08.880559 30459 webserver.cc:492] Webserver started at http://127.29.190.196:45009/ using document root <none> and password file <none>
I20251211 21:04:08.880712 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:08.880769 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:08.880839 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:08.881274 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-3-root/instance:
uuid: "2327d27b0bd449ea89201c0404e0915f"
format_stamp: "Formatted at 2025-12-11 21:04:08 on dist-test-slave-xjj2"
I20251211 21:04:08.883430 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20251211 21:04:08.884781 1737 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.885124 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:08.885207 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-3-root
uuid: "2327d27b0bd449ea89201c0404e0915f"
format_stamp: "Formatted at 2025-12-11 21:04:08 on dist-test-slave-xjj2"
I20251211 21:04:08.885279 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:08.910422 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:08.910836 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:08.911092 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:08.911536 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:08.911576 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.911645 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:08.911669 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.916453 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.196:36747
I20251211 21:04:08.916502 1800 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.196:36747 every 8 connection(s)
I20251211 21:04:08.917330 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:08.919162 1805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:08.919239 1806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:08.919323 1808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:08.919803 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:08.919962 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:08.920001 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:08.920017 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487048920017 us; error 0 us; skew 500 ppm
I20251211 21:04:08.920974 30459 webserver.cc:492] Webserver started at http://127.29.190.197:37029/ using document root <none> and password file <none>
I20251211 21:04:08.921123 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:08.921186 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:08.921262 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:08.921696 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-4-root/instance:
uuid: "aa211fd16a6744bbaa4bbb4545567bae"
format_stamp: "Formatted at 2025-12-11 21:04:08 on dist-test-slave-xjj2"
I20251211 21:04:08.921957 1801 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45383
I20251211 21:04:08.922052 1801 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:08.922302 1801 heartbeater.cc:507] Master 127.29.190.254:45383 requested a full tablet report, sending...
I20251211 21:04:08.922904 1263 ts_manager.cc:194] Registered new tserver with Master: 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:08.923427 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:04:08.923506 1263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48358
I20251211 21:04:08.924450 1813 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.924655 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:08.924714 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-4-root
uuid: "aa211fd16a6744bbaa4bbb4545567bae"
format_stamp: "Formatted at 2025-12-11 21:04:08 on dist-test-slave-xjj2"
I20251211 21:04:08.924778 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-4-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-4-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-4-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:08.936491 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:08.936920 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:08.937196 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:08.937639 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:08.937677 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.937708 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:08.937736 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.942394 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.197:43095
I20251211 21:04:08.942557 1876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.197:43095 every 8 connection(s)
I20251211 21:04:08.943202 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:08.944988 1880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:08.945094 1881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:08.945186 1883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:08.945746 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:08.945926 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:08.945972 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:08.946002 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487048946001 us; error 0 us; skew 500 ppm
I20251211 21:04:08.947149 30459 webserver.cc:492] Webserver started at http://127.29.190.198:36335/ using document root <none> and password file <none>
I20251211 21:04:08.947307 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:08.947369 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:08.947448 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:08.947512 1877 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45383
I20251211 21:04:08.947636 1877 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:08.947851 1877 heartbeater.cc:507] Master 127.29.190.254:45383 requested a full tablet report, sending...
I20251211 21:04:08.947997 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-5-root/instance:
uuid: "f5074d327f094246ad9acb355421d061"
format_stamp: "Formatted at 2025-12-11 21:04:08 on dist-test-slave-xjj2"
I20251211 21:04:08.948503 1263 ts_manager.cc:194] Registered new tserver with Master: aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095)
I20251211 21:04:08.949183 1263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48374
I20251211 21:04:08.949685 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:04:08.950589 1888 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.950796 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:08.950884 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-5-root
uuid: "f5074d327f094246ad9acb355421d061"
format_stamp: "Formatted at 2025-12-11 21:04:08 on dist-test-slave-xjj2"
I20251211 21:04:08.950947 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-5-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-5-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-5-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:08.966323 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:08.966747 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:08.967052 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:08.967528 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:08.967569 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.967639 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:08.967670 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:08.972327 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.198:40183
I20251211 21:04:08.972390 1951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.198:40183 every 8 connection(s)
I20251211 21:04:08.976868 1952 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45383
I20251211 21:04:08.976975 1952 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:08.977174 1952 heartbeater.cc:507] Master 127.29.190.254:45383 requested a full tablet report, sending...
I20251211 21:04:08.977713 1263 ts_manager.cc:194] Registered new tserver with Master: f5074d327f094246ad9acb355421d061 (127.29.190.198:40183)
I20251211 21:04:08.978246 1263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48390
I20251211 21:04:09.327584 1521 consensus_queue.cc:237] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:09.328966 1372 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.328995 1445 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.329414 1727 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.329747 1575 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.331071 1705 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:09.331408 1445 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:09.331542 1372 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:09.333973 1263 catalog_manager.cc:5654] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index -1 to 26, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251211 21:04:09.334673 1487 consensus_peers.cc:597] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 -> Peer f5074d327f094246ad9acb355421d061 (127.29.190.198:40183): Couldn't send request to peer f5074d327f094246ad9acb355421d061. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e90566476d56419683b3518348f96603. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:09.338223 1445 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:09.339537 1521 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.339512 1372 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.339993 1718 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.340178 1660 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.341647 1714 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:09.342005 1372 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:09.342119 1521 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
W20251211 21:04:09.344494 1412 consensus_peers.cc:597] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f -> Peer aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095): Couldn't send request to peer aa211fd16a6744bbaa4bbb4545567bae. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f04c059ecaa6400781a090ca30270262. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:09.344543 1261 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:09.345669 1521 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:09.346942 1372 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.346980 1445 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.347308 1726 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.347486 1727 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.348901 1621 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:09.349263 1445 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:09.349263 1372 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:09.351202 1262 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:09.351473 1521 consensus_queue.cc:237] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 2.25, Last appended by leader: 18, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
W20251211 21:04:09.352475 1487 consensus_peers.cc:597] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 -> Peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747): Couldn't send request to peer 2327d27b0bd449ea89201c0404e0915f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91d55fcc7df346549c84ae6cfdcf36ad. This is attempt 1: this message will repeat every 5th retry.
W20251211 21:04:09.353060 1487 consensus_peers.cc:597] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 -> Peer f5074d327f094246ad9acb355421d061 (127.29.190.198:40183): Couldn't send request to peer f5074d327f094246ad9acb355421d061. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3164db1c791a4cd7b4f9057f5f5e0cd9. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:09.353150 1370 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:09.353591 1705 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.354022 1445 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:09.354413 1705 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.355134 1621 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 LEADER]: Committing config change with OpId 2.26: config changed from index -1 to 26, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:09.355597 1370 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Committing config change with OpId 2.26: config changed from index -1 to 26, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:09.357517 1445 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.26: config changed from index -1 to 26, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:09.357748 1262 catalog_manager.cc:5654] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index -1 to 26, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New cstate: current_term: 2 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:09.358767 1443 consensus_queue.cc:237] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:09.360163 1521 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.360477 1660 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.361069 1372 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.361656 1660 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.362231 1715 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
W20251211 21:04:09.364321 1412 consensus_peers.cc:597] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f -> Peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747): Couldn't send request to peer 2327d27b0bd449ea89201c0404e0915f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e0e0cc37a5b41fd90c461aff17e8d28. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:09.364454 1263 catalog_manager.cc:5654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:09.364832 1518 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:09.365001 1443 consensus_queue.cc:237] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
W20251211 21:04:09.366389 1412 consensus_peers.cc:597] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f -> Peer aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095): Couldn't send request to peer aa211fd16a6744bbaa4bbb4545567bae. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c94dc3e2fd5d4db3aa515604c847331f. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:09.366698 1371 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.367131 1718 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.367571 1370 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:09.368467 1716 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:09.368928 1518 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:09.368851 1371 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:09.370626 1263 catalog_manager.cc:5654] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:09.371246 1660 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:09.372584 1518 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:09.741124 1966 ts_tablet_manager.cc:933] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: Initiating tablet copy from peer 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:09.741474 1966 tablet_copy_client.cc:323] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:34101
I20251211 21:04:09.745054 1458 tablet_copy_service.cc:140] P 22f0fcdd6d614884843d6ef3bca6708f: Received BeginTabletCopySession request for tablet f04c059ecaa6400781a090ca30270262 from peer aa211fd16a6744bbaa4bbb4545567bae ({username='slave'} at 127.0.0.1:58108)
I20251211 21:04:09.745163 1458 tablet_copy_service.cc:161] P 22f0fcdd6d614884843d6ef3bca6708f: Beginning new tablet copy session on tablet f04c059ecaa6400781a090ca30270262 from peer aa211fd16a6744bbaa4bbb4545567bae at {username='slave'} at 127.0.0.1:58108: session id = aa211fd16a6744bbaa4bbb4545567bae-f04c059ecaa6400781a090ca30270262
I20251211 21:04:09.746057 1458 tablet_copy_source_session.cc:215] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:09.746873 1966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04c059ecaa6400781a090ca30270262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:09.748910 1966 tablet_copy_client.cc:806] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:09.749058 1966 tablet_copy_client.cc:670] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:09.750033 1967 tablet_copy_client.cc:1025] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:09.760779 1969 ts_tablet_manager.cc:933] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: Initiating tablet copy from peer 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:09.761190 1969 tablet_copy_client.cc:323] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:45051
I20251211 21:04:09.765053 1533 tablet_copy_service.cc:140] P 5eec57358d0f4ba48d683b4c7d445454: Received BeginTabletCopySession request for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 from peer f5074d327f094246ad9acb355421d061 ({username='slave'} at 127.0.0.1:56302)
I20251211 21:04:09.765177 1533 tablet_copy_service.cc:161] P 5eec57358d0f4ba48d683b4c7d445454: Beginning new tablet copy session on tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 from peer f5074d327f094246ad9acb355421d061 at {username='slave'} at 127.0.0.1:56302: session id = f5074d327f094246ad9acb355421d061-3164db1c791a4cd7b4f9057f5f5e0cd9
I20251211 21:04:09.766024 1533 tablet_copy_source_session.cc:215] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:09.766841 1969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:09.769026 1969 tablet_copy_client.cc:806] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:09.769191 1969 tablet_copy_client.cc:670] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:09.770072 1970 tablet_copy_client.cc:1025] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:09.784478 1972 ts_tablet_manager.cc:933] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: Initiating tablet copy from peer 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:09.784866 1972 tablet_copy_client.cc:323] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:34101
I20251211 21:04:09.785298 1458 tablet_copy_service.cc:140] P 22f0fcdd6d614884843d6ef3bca6708f: Received BeginTabletCopySession request for tablet c94dc3e2fd5d4db3aa515604c847331f from peer aa211fd16a6744bbaa4bbb4545567bae ({username='slave'} at 127.0.0.1:58108)
I20251211 21:04:09.785390 1458 tablet_copy_service.cc:161] P 22f0fcdd6d614884843d6ef3bca6708f: Beginning new tablet copy session on tablet c94dc3e2fd5d4db3aa515604c847331f from peer aa211fd16a6744bbaa4bbb4545567bae at {username='slave'} at 127.0.0.1:58108: session id = aa211fd16a6744bbaa4bbb4545567bae-c94dc3e2fd5d4db3aa515604c847331f
I20251211 21:04:09.786306 1458 tablet_copy_source_session.cc:215] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:09.787259 1972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94dc3e2fd5d4db3aa515604c847331f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:09.789358 1972 tablet_copy_client.cc:806] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:09.789497 1972 tablet_copy_client.cc:670] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:09.790417 1973 tablet_copy_client.cc:1025] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:09.828984 1974 ts_tablet_manager.cc:933] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: Initiating tablet copy from peer 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:09.829371 1974 tablet_copy_client.cc:323] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:34101
I20251211 21:04:09.832938 1458 tablet_copy_service.cc:140] P 22f0fcdd6d614884843d6ef3bca6708f: Received BeginTabletCopySession request for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 from peer 2327d27b0bd449ea89201c0404e0915f ({username='slave'} at 127.0.0.1:58120)
I20251211 21:04:09.833063 1458 tablet_copy_service.cc:161] P 22f0fcdd6d614884843d6ef3bca6708f: Beginning new tablet copy session on tablet 2e0e0cc37a5b41fd90c461aff17e8d28 from peer 2327d27b0bd449ea89201c0404e0915f at {username='slave'} at 127.0.0.1:58120: session id = 2327d27b0bd449ea89201c0404e0915f-2e0e0cc37a5b41fd90c461aff17e8d28
I20251211 21:04:09.833846 1458 tablet_copy_source_session.cc:215] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:09.834582 1974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0e0cc37a5b41fd90c461aff17e8d28. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:09.837067 1974 tablet_copy_client.cc:806] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:09.837231 1974 tablet_copy_client.cc:670] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:09.838466 1975 tablet_copy_client.cc:1025] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:09.924379 1801 heartbeater.cc:499] Master 127.29.190.254:45383 was elected leader, sending a full tablet report...
I20251211 21:04:09.935050 1977 ts_tablet_manager.cc:933] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: Initiating tablet copy from peer 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:09.935410 1977 tablet_copy_client.cc:323] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:45051
I20251211 21:04:09.935819 1533 tablet_copy_service.cc:140] P 5eec57358d0f4ba48d683b4c7d445454: Received BeginTabletCopySession request for tablet e90566476d56419683b3518348f96603 from peer f5074d327f094246ad9acb355421d061 ({username='slave'} at 127.0.0.1:56302)
I20251211 21:04:09.935956 1533 tablet_copy_service.cc:161] P 5eec57358d0f4ba48d683b4c7d445454: Beginning new tablet copy session on tablet e90566476d56419683b3518348f96603 from peer f5074d327f094246ad9acb355421d061 at {username='slave'} at 127.0.0.1:56302: session id = f5074d327f094246ad9acb355421d061-e90566476d56419683b3518348f96603
I20251211 21:04:09.936872 1533 tablet_copy_source_session.cc:215] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:09.937577 1977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90566476d56419683b3518348f96603. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:09.939661 1977 tablet_copy_client.cc:806] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:09.939816 1977 tablet_copy_client.cc:670] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:09.940707 1978 tablet_copy_client.cc:1025] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:09.950047 1877 heartbeater.cc:499] Master 127.29.190.254:45383 was elected leader, sending a full tablet report...
I20251211 21:04:09.953804 1980 ts_tablet_manager.cc:933] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: Initiating tablet copy from peer 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:09.954167 1980 tablet_copy_client.cc:323] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:45051
I20251211 21:04:09.957434 1533 tablet_copy_service.cc:140] P 5eec57358d0f4ba48d683b4c7d445454: Received BeginTabletCopySession request for tablet 91d55fcc7df346549c84ae6cfdcf36ad from peer 2327d27b0bd449ea89201c0404e0915f ({username='slave'} at 127.0.0.1:56312)
I20251211 21:04:09.957549 1533 tablet_copy_service.cc:161] P 5eec57358d0f4ba48d683b4c7d445454: Beginning new tablet copy session on tablet 91d55fcc7df346549c84ae6cfdcf36ad from peer 2327d27b0bd449ea89201c0404e0915f at {username='slave'} at 127.0.0.1:56312: session id = 2327d27b0bd449ea89201c0404e0915f-91d55fcc7df346549c84ae6cfdcf36ad
I20251211 21:04:09.958436 1533 tablet_copy_source_session.cc:215] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:09.959190 1980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d55fcc7df346549c84ae6cfdcf36ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:09.961402 1980 tablet_copy_client.cc:806] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:09.961563 1980 tablet_copy_client.cc:670] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:09.962599 1981 tablet_copy_client.cc:1025] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:09.978960 1952 heartbeater.cc:499] Master 127.29.190.254:45383 was elected leader, sending a full tablet report...
I20251211 21:04:10.347888 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:10.348984 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:10.349088 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:11.750331 1966 tablet_copy_client.cc:538] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:11.751895 1966 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap starting.
I20251211 21:04:11.770332 1969 tablet_copy_client.cc:538] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:11.771993 1969 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: Bootstrap starting.
I20251211 21:04:11.776391 1966 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=114 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:11.776659 1966 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap complete.
I20251211 21:04:11.776901 1966 ts_tablet_manager.cc:1403] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: Time spent bootstrapping tablet: real 0.025s user 0.025s sys 0.000s
I20251211 21:04:11.777371 1966 raft_consensus.cc:359] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:11.777509 1966 raft_consensus.cc:740] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Initialized, Role: LEARNER
I20251211 21:04:11.777652 1966 consensus_queue.cc:260] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:11.778019 1966 ts_tablet_manager.cc:1434] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:11.778447 1458 tablet_copy_service.cc:342] P 22f0fcdd6d614884843d6ef3bca6708f: Request end of tablet copy session aa211fd16a6744bbaa4bbb4545567bae-f04c059ecaa6400781a090ca30270262 received from {username='slave'} at 127.0.0.1:58108
I20251211 21:04:11.778529 1458 tablet_copy_service.cc:434] P 22f0fcdd6d614884843d6ef3bca6708f: ending tablet copy session aa211fd16a6744bbaa4bbb4545567bae-f04c059ecaa6400781a090ca30270262 on tablet f04c059ecaa6400781a090ca30270262 with peer aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:11.790668 1972 tablet_copy_client.cc:538] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:11.792222 1972 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap starting.
I20251211 21:04:11.793740 1969 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=94 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:11.793991 1969 tablet_bootstrap.cc:492] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: Bootstrap complete.
I20251211 21:04:11.794152 1969 ts_tablet_manager.cc:1403] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.000s
I20251211 21:04:11.794620 1969 raft_consensus.cc:359] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:11.794741 1969 raft_consensus.cc:740] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f5074d327f094246ad9acb355421d061, State: Initialized, Role: LEARNER
I20251211 21:04:11.794834 1969 consensus_queue.cc:260] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 2.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:11.795476 1969 ts_tablet_manager.cc:1434] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251211 21:04:11.796346 1533 tablet_copy_service.cc:342] P 5eec57358d0f4ba48d683b4c7d445454: Request end of tablet copy session f5074d327f094246ad9acb355421d061-3164db1c791a4cd7b4f9057f5f5e0cd9 received from {username='slave'} at 127.0.0.1:56302
I20251211 21:04:11.796429 1533 tablet_copy_service.cc:434] P 5eec57358d0f4ba48d683b4c7d445454: ending tablet copy session f5074d327f094246ad9acb355421d061-3164db1c791a4cd7b4f9057f5f5e0cd9 on tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 with peer f5074d327f094246ad9acb355421d061
I20251211 21:04:11.796924 1926 raft_consensus.cc:1217] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.25->[2.26-2.26] Dedup: 2.26->[]
I20251211 21:04:11.813699 1972 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=95 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:11.814000 1972 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap complete.
I20251211 21:04:11.814200 1972 ts_tablet_manager.cc:1403] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: Time spent bootstrapping tablet: real 0.022s user 0.015s sys 0.005s
I20251211 21:04:11.814683 1972 raft_consensus.cc:359] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:11.814821 1972 raft_consensus.cc:740] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Initialized, Role: LEARNER
I20251211 21:04:11.814917 1972 consensus_queue.cc:260] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:11.815186 1972 ts_tablet_manager.cc:1434] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:11.815559 1458 tablet_copy_service.cc:342] P 22f0fcdd6d614884843d6ef3bca6708f: Request end of tablet copy session aa211fd16a6744bbaa4bbb4545567bae-c94dc3e2fd5d4db3aa515604c847331f received from {username='slave'} at 127.0.0.1:58108
I20251211 21:04:11.815682 1458 tablet_copy_service.cc:434] P 22f0fcdd6d614884843d6ef3bca6708f: ending tablet copy session aa211fd16a6744bbaa4bbb4545567bae-c94dc3e2fd5d4db3aa515604c847331f on tablet c94dc3e2fd5d4db3aa515604c847331f with peer aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:11.838891 1974 tablet_copy_client.cc:538] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:11.840500 1974 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap starting.
I20251211 21:04:11.851949 1851 raft_consensus.cc:1217] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Deduplicated request from leader. Original: 1.25->[1.26-1.26] Dedup: 1.26->[]
I20251211 21:04:11.862519 1974 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=101 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:11.862831 1974 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap complete.
I20251211 21:04:11.863013 1974 ts_tablet_manager.cc:1403] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.003s
I20251211 21:04:11.863507 1974 raft_consensus.cc:359] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:11.863631 1974 raft_consensus.cc:740] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Initialized, Role: LEARNER
I20251211 21:04:11.863735 1974 consensus_queue.cc:260] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:11.864056 1974 ts_tablet_manager.cc:1434] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: Time spent starting tablet: real 0.001s user 0.001s sys 0.004s
I20251211 21:04:11.864468 1458 tablet_copy_service.cc:342] P 22f0fcdd6d614884843d6ef3bca6708f: Request end of tablet copy session 2327d27b0bd449ea89201c0404e0915f-2e0e0cc37a5b41fd90c461aff17e8d28 received from {username='slave'} at 127.0.0.1:58120
I20251211 21:04:11.864547 1458 tablet_copy_service.cc:434] P 22f0fcdd6d614884843d6ef3bca6708f: ending tablet copy session 2327d27b0bd449ea89201c0404e0915f-2e0e0cc37a5b41fd90c461aff17e8d28 on tablet 2e0e0cc37a5b41fd90c461aff17e8d28 with peer 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:11.889730 1775 raft_consensus.cc:1217] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.25->[1.26-1.26] Dedup: 1.26->[]
I20251211 21:04:11.941033 1977 tablet_copy_client.cc:538] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:11.942618 1977 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: Bootstrap starting.
I20251211 21:04:11.962888 1980 tablet_copy_client.cc:538] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:11.964208 1980 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: Bootstrap starting.
I20251211 21:04:11.964468 1977 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=84 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:11.964728 1977 tablet_bootstrap.cc:492] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: Bootstrap complete.
I20251211 21:04:11.964902 1977 ts_tablet_manager.cc:1403] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: Time spent bootstrapping tablet: real 0.022s user 0.019s sys 0.004s
I20251211 21:04:11.965333 1977 raft_consensus.cc:359] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:11.965438 1977 raft_consensus.cc:740] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5074d327f094246ad9acb355421d061, State: Initialized, Role: LEARNER
I20251211 21:04:11.965512 1977 consensus_queue.cc:260] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:11.965757 1977 ts_tablet_manager.cc:1434] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:11.966275 1533 tablet_copy_service.cc:342] P 5eec57358d0f4ba48d683b4c7d445454: Request end of tablet copy session f5074d327f094246ad9acb355421d061-e90566476d56419683b3518348f96603 received from {username='slave'} at 127.0.0.1:56302
I20251211 21:04:11.966344 1533 tablet_copy_service.cc:434] P 5eec57358d0f4ba48d683b4c7d445454: ending tablet copy session f5074d327f094246ad9acb355421d061-e90566476d56419683b3518348f96603 on tablet e90566476d56419683b3518348f96603 with peer f5074d327f094246ad9acb355421d061
I20251211 21:04:11.984452 1980 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=105 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:11.984702 1980 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: Bootstrap complete.
I20251211 21:04:11.984872 1980 ts_tablet_manager.cc:1403] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.003s
I20251211 21:04:11.985352 1980 raft_consensus.cc:359] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:11.985481 1980 raft_consensus.cc:740] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Initialized, Role: LEARNER
I20251211 21:04:11.985595 1980 consensus_queue.cc:260] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:11.985960 1980 ts_tablet_manager.cc:1434] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:04:11.986406 1533 tablet_copy_service.cc:342] P 5eec57358d0f4ba48d683b4c7d445454: Request end of tablet copy session 2327d27b0bd449ea89201c0404e0915f-91d55fcc7df346549c84ae6cfdcf36ad received from {username='slave'} at 127.0.0.1:56312
I20251211 21:04:11.986483 1533 tablet_copy_service.cc:434] P 5eec57358d0f4ba48d683b4c7d445454: ending tablet copy session 2327d27b0bd449ea89201c0404e0915f-91d55fcc7df346549c84ae6cfdcf36ad on tablet 91d55fcc7df346549c84ae6cfdcf36ad with peer 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:12.025622 1775 raft_consensus.cc:1217] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.25->[1.26-1.26] Dedup: 1.26->[]
I20251211 21:04:12.182833 1926 raft_consensus.cc:1217] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.25->[1.26-1.26] Dedup: 1.26->[]
I20251211 21:04:12.312595 1993 raft_consensus.cc:1064] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454: attempting to promote NON_VOTER f5074d327f094246ad9acb355421d061 to VOTER
I20251211 21:04:12.313190 1993 consensus_queue.cc:237] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 2.26, Last appended by leader: 18, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:12.314553 1445 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:12.314608 1926 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:12.314878 1370 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:12.315210 1996 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.315477 1994 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.315740 1705 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.317795 1996 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 LEADER]: Committing config change with OpId 2.27: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.318188 1926 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Committing config change with OpId 2.27: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.318261 1370 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Committing config change with OpId 2.27: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.320389 1261 catalog_manager.cc:5654] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.320832 1443 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.27: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.324301 1518 consensus_queue.cc:237] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 18, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:12.325362 1926 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:12.325364 1370 raft_consensus.cc:1275] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:12.325731 1993 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.326074 1993 consensus_queue.cc:1048] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.327100 1705 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 LEADER]: Committing config change with OpId 2.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.327407 1926 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.327961 1370 raft_consensus.cc:2955] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.329216 1255 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:12.329562 1266 catalog_manager.cc:5654] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New cstate: current_term: 2 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.331832 1433 tablet_service.cc:1552] Processing DeleteTablet for tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 with delete_type TABLET_DATA_TOMBSTONED (TS 22f0fcdd6d614884843d6ef3bca6708f not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:12.332245 2004 tablet_replica.cc:333] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:12.332383 2004 raft_consensus.cc:2243] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:12.332544 2004 raft_consensus.cc:2272] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:12.333190 2004 ts_tablet_manager.cc:1916] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:12.335304 2004 ts_tablet_manager.cc:1929] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.27
I20251211 21:04:12.335376 2004 log.cc:1199] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/3164db1c791a4cd7b4f9057f5f5e0cd9
I20251211 21:04:12.335924 1253 catalog_manager.cc:4985] TS 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101): tablet 3164db1c791a4cd7b4f9057f5f5e0cd9 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:12.348805 1851 raft_consensus.cc:1217] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Deduplicated request from leader. Original: 1.25->[1.26-1.26] Dedup: 1.26->[]
I20251211 21:04:12.349382 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:12.351292 1370 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:12.351459 1370 raft_consensus.cc:606] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:12.359695 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f04c059ecaa6400781a090ca30270262"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:12.359859 1445 raft_consensus.cc:606] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:12.360205 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251211 21:04:12.360351 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:12.419672 1983 raft_consensus.cc:993] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:12.419783 1983 raft_consensus.cc:1081] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:12.420153 1370 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f04c059ecaa6400781a090ca30270262"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40782
I20251211 21:04:12.420310 1370 raft_consensus.cc:493] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:12.420377 1370 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:12.421362 1370 raft_consensus.cc:515] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:12.421753 1370 leader_election.cc:290] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 2 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:12.421999 1518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:12.422036 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:12.422115 1518 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:12.422138 1445 raft_consensus.cc:3055] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:12.422173 1445 raft_consensus.cc:740] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:12.422315 1445 consensus_queue.cc:260] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:12.422479 1445 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:12.422991 1518 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 2.
I20251211 21:04:12.423296 1337 leader_election.cc:304] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:12.423339 1445 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 2.
I20251211 21:04:12.423466 1720 raft_consensus.cc:2804] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:12.423714 1720 raft_consensus.cc:697] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:12.423866 1720 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:12.425556 1262 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 1 to 2, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 2 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:12.465719 2010 raft_consensus.cc:1064] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
I20251211 21:04:12.466203 2010 consensus_queue.cc:237] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:12.467576 1851 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.467770 1518 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.467581 1370 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.467980 2010 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.468330 2010 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.468513 2012 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.470566 1983 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.470965 1370 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.471943 1521 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.472885 1851 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.473181 1262 catalog_manager.cc:5654] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.476399 1443 consensus_queue.cc:237] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:12.477406 1370 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:12.477818 2010 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.477907 1851 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:12.478363 2010 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.479202 2007 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.479893 1371 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.481304 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c94dc3e2fd5d4db3aa515604c847331f with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:12.481442 1263 catalog_manager.cc:5654] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:12.482301 1851 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.485335 1509 tablet_service.cc:1552] Processing DeleteTablet for tablet c94dc3e2fd5d4db3aa515604c847331f with delete_type TABLET_DATA_TOMBSTONED (TS 5eec57358d0f4ba48d683b4c7d445454 not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:12.485786 2016 tablet_replica.cc:333] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:12.485980 2016 raft_consensus.cc:2243] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:12.486181 2016 raft_consensus.cc:2272] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:12.486766 2016 ts_tablet_manager.cc:1916] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:12.488664 2016 ts_tablet_manager.cc:1929] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.27
I20251211 21:04:12.488747 2016 log.cc:1199] T c94dc3e2fd5d4db3aa515604c847331f P 5eec57358d0f4ba48d683b4c7d445454: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/c94dc3e2fd5d4db3aa515604c847331f
I20251211 21:04:12.489281 1255 catalog_manager.cc:4985] TS 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051): tablet c94dc3e2fd5d4db3aa515604c847331f (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:12.499311 2012 raft_consensus.cc:1064] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER 2327d27b0bd449ea89201c0404e0915f to VOTER
I20251211 21:04:12.499774 2012 consensus_queue.cc:237] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:12.501190 1775 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.501390 1371 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.501190 1518 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.501539 2010 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.501811 2012 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.502012 1983 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.503481 2012 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.503861 1371 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.504758 1518 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.505700 1775 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.506786 1261 catalog_manager.cc:5654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.508649 1705 raft_consensus.cc:1064] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: attempting to promote NON_VOTER 2327d27b0bd449ea89201c0404e0915f to VOTER
I20251211 21:04:12.509023 1705 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:12.510037 1443 consensus_queue.cc:237] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:12.510211 1775 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.510283 1371 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.510540 1996 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.510614 1445 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.510825 1705 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.511210 1774 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:12.511586 2007 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.512576 1521 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:12.512759 1705 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.512910 2007 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.514189 1993 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.514925 2007 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.515239 1518 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.515887 1774 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.516328 1371 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.516707 1445 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.517267 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:12.518361 1266 catalog_manager.cc:5654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 27 to 28, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.518476 1263 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.520135 1774 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.521003 1357 tablet_service.cc:1552] Processing DeleteTablet for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 with delete_type TABLET_DATA_TOMBSTONED (TS 2d3e56eb6a174c3eb932f4bcdc62e18c not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:12.522240 2025 tablet_replica.cc:333] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:12.523234 2025 raft_consensus.cc:2243] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:12.523407 2025 raft_consensus.cc:2272] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:12.523993 1518 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:12.524577 2025 ts_tablet_manager.cc:1916] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:12.525007 1774 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:12.525058 1445 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:12.525470 1993 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.525765 1993 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.527084 2025 ts_tablet_manager.cc:1929] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.27
I20251211 21:04:12.527161 2025 log.cc:1199] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/2e0e0cc37a5b41fd90c461aff17e8d28
I20251211 21:04:12.527179 1993 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.528535 1253 catalog_manager.cc:4985] TS 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469): tablet 2e0e0cc37a5b41fd90c461aff17e8d28 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:12.528590 1774 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.528905 1255 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 91d55fcc7df346549c84ae6cfdcf36ad with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:12.529316 1262 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 27 to 28, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.529359 1445 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:12.531637 1357 tablet_service.cc:1552] Processing DeleteTablet for tablet 91d55fcc7df346549c84ae6cfdcf36ad with delete_type TABLET_DATA_TOMBSTONED (TS 2d3e56eb6a174c3eb932f4bcdc62e18c not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:12.531953 2025 tablet_replica.cc:333] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:12.532089 2025 raft_consensus.cc:2243] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:12.532222 2025 raft_consensus.cc:2272] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:12.532953 2025 ts_tablet_manager.cc:1916] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:12.535084 2025 ts_tablet_manager.cc:1929] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.27
I20251211 21:04:12.535169 2025 log.cc:1199] T 91d55fcc7df346549c84ae6cfdcf36ad P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/91d55fcc7df346549c84ae6cfdcf36ad
I20251211 21:04:12.535668 1253 catalog_manager.cc:4985] TS 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469): tablet 91d55fcc7df346549c84ae6cfdcf36ad (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:12.579769 1705 raft_consensus.cc:1064] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: attempting to promote NON_VOTER f5074d327f094246ad9acb355421d061 to VOTER
I20251211 21:04:12.580180 1705 consensus_queue.cc:237] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:12.581424 1926 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.581636 1445 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.581769 1993 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.581934 1371 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:12.582235 1993 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.582521 1993 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.584177 1993 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.584592 1371 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.586431 1445 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.586442 1263 catalog_manager.cc:5654] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.587778 1926 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.589156 1518 consensus_queue.cc:237] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:12.590544 1371 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:12.590562 1926 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:12.590960 1994 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.591272 1994 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.592361 1996 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.592885 1926 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.593641 1370 raft_consensus.cc:2955] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:12.594003 1255 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet e90566476d56419683b3518348f96603 with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:12.594338 1263 catalog_manager.cc:5654] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New cstate: current_term: 1 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.597165 1433 tablet_service.cc:1552] Processing DeleteTablet for tablet e90566476d56419683b3518348f96603 with delete_type TABLET_DATA_TOMBSTONED (TS 22f0fcdd6d614884843d6ef3bca6708f not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:12.597361 2004 tablet_replica.cc:333] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:12.597486 2004 raft_consensus.cc:2243] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:12.597610 2004 raft_consensus.cc:2272] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:12.598210 2004 ts_tablet_manager.cc:1916] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:12.600047 2004 ts_tablet_manager.cc:1929] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.27
I20251211 21:04:12.600109 2004 log.cc:1199] T e90566476d56419683b3518348f96603 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/e90566476d56419683b3518348f96603
I20251211 21:04:12.600535 1253 catalog_manager.cc:4985] TS 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101): tablet e90566476d56419683b3518348f96603 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:12.824481 2008 raft_consensus.cc:993] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:12.824630 2008 raft_consensus.cc:1081] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:12.825022 1445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:12.825178 1445 raft_consensus.cc:493] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:12.825248 1445 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:12.826381 1445 raft_consensus.cc:515] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:12.826750 1445 leader_election.cc:290] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 2 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:12.827132 1370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:12.827165 1518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:12.827242 1370 raft_consensus.cc:3055] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:12.827263 1518 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:12.827284 1370 raft_consensus.cc:740] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:12.827412 1370 consensus_queue.cc:260] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 25, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:12.827557 1370 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:12.828235 1518 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 2.
I20251211 21:04:12.828444 1370 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 2.
I20251211 21:04:12.828500 1413 leader_election.cc:304] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:12.828655 2012 raft_consensus.cc:2804] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:12.828739 2012 raft_consensus.cc:697] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:12.828869 2012 consensus_queue.cc:237] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 25, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:12.830322 1263 catalog_manager.cc:5654] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 1 to 2, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 2 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:12.877821 1445 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:12.878271 2008 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.885835 1518 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:12.886425 2008 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.890941 1851 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Advancing to term 2
I20251211 21:04:12.892043 1851 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:12.892374 2008 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:12.894129 2008 raft_consensus.cc:1064] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
I20251211 21:04:12.894523 2008 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 26, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:12.895730 1518 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:12.895789 1445 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:12.896052 1720 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.896215 2008 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.896629 1851 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:12.897042 2008 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:12.898134 1720 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Committing config change with OpId 2.28: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.899266 1851 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.900086 1518 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.900350 1445 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.902115 1262 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.904773 1371 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 2.28, Last appended by leader: 26, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:12.905890 1445 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:12.905925 1851 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:12.906213 2041 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:12.906432 2033 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:12.907985 2041 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Committing config change with OpId 2.29: config changed from index 28 to 29, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.908277 1445 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.29: config changed from index 28 to 29, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.908506 1851 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Committing config change with OpId 2.29: config changed from index 28 to 29, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:12.909539 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet f04c059ecaa6400781a090ca30270262 with cas_config_opid_index 28: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:12.910393 1263 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 28 to 29, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New cstate: current_term: 2 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:12.912938 1509 tablet_service.cc:1552] Processing DeleteTablet for tablet f04c059ecaa6400781a090ca30270262 with delete_type TABLET_DATA_TOMBSTONED (TS 5eec57358d0f4ba48d683b4c7d445454 not found in new config with opid_index 29) from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:12.913367 2016 tablet_replica.cc:333] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:12.913486 2016 raft_consensus.cc:2243] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:12.913599 2016 raft_consensus.cc:2272] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:12.914175 2016 ts_tablet_manager.cc:1916] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:12.916018 2016 ts_tablet_manager.cc:1929] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.28
I20251211 21:04:12.916091 2016 log.cc:1199] T f04c059ecaa6400781a090ca30270262 P 5eec57358d0f4ba48d683b4c7d445454: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/f04c059ecaa6400781a090ca30270262
I20251211 21:04:12.916502 1255 catalog_manager.cc:4985] TS 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051): tablet f04c059ecaa6400781a090ca30270262 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:13.387213 1370 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:13.387652 2010 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:13.390319 1518 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:13.390880 2010 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:13.914697 1445 consensus_queue.cc:237] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 2.26, Last appended by leader: 25, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:13.916088 1518 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:13.916103 1370 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:13.916483 2047 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:13.916658 2010 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:13.918161 2047 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Committing config change with OpId 2.27: config changed from index -1 to 27, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:13.918433 1370 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Committing config change with OpId 2.27: config changed from index -1 to 27, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:13.920583 1518 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Committing config change with OpId 2.27: config changed from index -1 to 27, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:13.920868 1261 catalog_manager.cc:5654] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index -1 to 27, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New cstate: current_term: 2 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251211 21:04:13.921039 1412 consensus_peers.cc:597] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f -> Peer f5074d327f094246ad9acb355421d061 (127.29.190.198:40183): Couldn't send request to peer f5074d327f094246ad9acb355421d061. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b336d873366440aa05f76b89a75710a. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:13.921545 1445 consensus_queue.cc:237] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:13.922699 1370 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
W20251211 21:04:13.923003 1412 consensus_peers.cc:597] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f -> Peer aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095): Couldn't send request to peer aa211fd16a6744bbaa4bbb4545567bae. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70e1f34692834e4cb9ffbdbbbc356141. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:13.923043 2048 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:13.923269 1518 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:13.923559 2047 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:13.925412 2047 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:13.925915 1370 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:13.926239 1518 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:13.928464 1263 catalog_manager.cc:5654] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:13.933241 1370 consensus_queue.cc:237] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:13.934533 1518 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:13.934854 2061 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:13.934916 1445 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:13.935232 2061 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:13.936515 2062 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:13.936908 1518 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:13.938952 1261 catalog_manager.cc:5654] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:13.939070 1443 consensus_queue.cc:237] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
W20251211 21:04:13.939846 1336 consensus_peers.cc:597] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c -> Peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747): Couldn't send request to peer 2327d27b0bd449ea89201c0404e0915f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77c000525583471e957c31b719d95ea0. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:13.939023 1445 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:13.940344 1370 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251211 21:04:13.940469 1851 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251211 21:04:13.940658 2010 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:13.940824 2047 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
W20251211 21:04:13.941006 1412 consensus_peers.cc:597] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f -> Peer f5074d327f094246ad9acb355421d061 (127.29.190.198:40183): Couldn't send request to peer f5074d327f094246ad9acb355421d061. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c94dc3e2fd5d4db3aa515604c847331f. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:13.942852 2048 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:13.943219 1851 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:13.944334 1370 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:13.945130 1261 catalog_manager.cc:5654] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 28 to 29, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:13.946601 1370 consensus_queue.cc:237] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:13.947834 1445 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
W20251211 21:04:13.947990 1336 consensus_peers.cc:597] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c -> Peer aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095): Couldn't send request to peer aa211fd16a6744bbaa4bbb4545567bae. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 605e369cbf1b4052b066b230cc165bb7. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:13.948030 1518 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251211 21:04:13.948211 2061 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:13.948488 2061 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:13.949739 2062 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:13.950222 1445 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:13.950271 1518 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:13.952280 1266 catalog_manager.cc:5654] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index -1 to 26, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:13.953028 1370 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
W20251211 21:04:13.954504 1336 consensus_peers.cc:597] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c -> Peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747): Couldn't send request to peer 2327d27b0bd449ea89201c0404e0915f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9afcbdf999514a22badd7550b63d8cb8. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:13.954728 1518 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20251211 21:04:13.954839 1445 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20251211 21:04:13.955019 2062 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20251211 21:04:13.955155 2061 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20251211 21:04:13.956688 2041 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Committing config change with OpId 1.25: config changed from index -1 to 25, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:13.957105 1518 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index -1 to 25, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:13.957991 1445 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index -1 to 25, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:13.958926 1261 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index -1 to 25, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:14.293637 2077 ts_tablet_manager.cc:933] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: Initiating tablet copy from peer 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:14.294031 2077 tablet_copy_client.cc:323] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:34101
I20251211 21:04:14.298007 1458 tablet_copy_service.cc:140] P 22f0fcdd6d614884843d6ef3bca6708f: Received BeginTabletCopySession request for tablet 9b336d873366440aa05f76b89a75710a from peer f5074d327f094246ad9acb355421d061 ({username='slave'} at 127.0.0.1:46506)
I20251211 21:04:14.298146 1458 tablet_copy_service.cc:161] P 22f0fcdd6d614884843d6ef3bca6708f: Beginning new tablet copy session on tablet 9b336d873366440aa05f76b89a75710a from peer f5074d327f094246ad9acb355421d061 at {username='slave'} at 127.0.0.1:46506: session id = f5074d327f094246ad9acb355421d061-9b336d873366440aa05f76b89a75710a
I20251211 21:04:14.298969 1458 tablet_copy_source_session.cc:215] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:14.299772 2077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b336d873366440aa05f76b89a75710a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:14.301786 2077 tablet_copy_client.cc:806] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:14.301947 2077 tablet_copy_client.cc:670] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:14.302932 2078 tablet_copy_client.cc:1025] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:14.360595 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:14.362197 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2e0e0cc37a5b41fd90c461aff17e8d28"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "2327d27b0bd449ea89201c0404e0915f"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:14.362346 1445 raft_consensus.cc:606] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Received request to transfer leadership to TS 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:14.366640 1518 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:43430
I20251211 21:04:14.366781 1518 raft_consensus.cc:606] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:14.367471 2083 ts_tablet_manager.cc:933] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: Initiating tablet copy from peer 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469)
I20251211 21:04:14.367652 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:14.367784 1371 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:14.367866 2083 tablet_copy_client.cc:323] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.193:33469
I20251211 21:04:14.368841 1518 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:43430
I20251211 21:04:14.368937 1518 raft_consensus.cc:606] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:14.370199 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c94dc3e2fd5d4db3aa515604c847331f"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:14.370311 1445 raft_consensus.cc:606] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Received request to transfer leadership to TS aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:14.371176 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f04c059ecaa6400781a090ca30270262"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:14.371281 1371 raft_consensus.cc:606] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:14.371596 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20251211 21:04:14.371750 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:14.371949 1382 tablet_copy_service.cc:140] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Received BeginTabletCopySession request for tablet 9afcbdf999514a22badd7550b63d8cb8 from peer 2327d27b0bd449ea89201c0404e0915f ({username='slave'} at 127.0.0.1:32972)
I20251211 21:04:14.372020 1382 tablet_copy_service.cc:161] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Beginning new tablet copy session on tablet 9afcbdf999514a22badd7550b63d8cb8 from peer 2327d27b0bd449ea89201c0404e0915f at {username='slave'} at 127.0.0.1:32972: session id = 2327d27b0bd449ea89201c0404e0915f-9afcbdf999514a22badd7550b63d8cb8
I20251211 21:04:14.373032 1382 tablet_copy_source_session.cc:215] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:14.373790 2083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afcbdf999514a22badd7550b63d8cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:14.376204 2083 tablet_copy_client.cc:806] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:14.376349 2083 tablet_copy_client.cc:670] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:14.377272 2084 tablet_copy_client.cc:1025] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:14.402173 2086 ts_tablet_manager.cc:933] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: Initiating tablet copy from peer 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469)
I20251211 21:04:14.402585 2086 tablet_copy_client.cc:323] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.193:33469
I20251211 21:04:14.406533 1382 tablet_copy_service.cc:140] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Received BeginTabletCopySession request for tablet 605e369cbf1b4052b066b230cc165bb7 from peer aa211fd16a6744bbaa4bbb4545567bae ({username='slave'} at 127.0.0.1:32976)
I20251211 21:04:14.406646 1382 tablet_copy_service.cc:161] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Beginning new tablet copy session on tablet 605e369cbf1b4052b066b230cc165bb7 from peer aa211fd16a6744bbaa4bbb4545567bae at {username='slave'} at 127.0.0.1:32976: session id = aa211fd16a6744bbaa4bbb4545567bae-605e369cbf1b4052b066b230cc165bb7
I20251211 21:04:14.407624 1382 tablet_copy_source_session.cc:215] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:14.408360 2086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e369cbf1b4052b066b230cc165bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:14.410667 2086 tablet_copy_client.cc:806] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:14.410835 2086 tablet_copy_client.cc:670] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:14.411720 2087 tablet_copy_client.cc:1025] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:14.421838 2089 ts_tablet_manager.cc:933] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: Initiating tablet copy from peer 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469)
I20251211 21:04:14.422175 2089 tablet_copy_client.cc:323] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.193:33469
I20251211 21:04:14.422549 1382 tablet_copy_service.cc:140] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Received BeginTabletCopySession request for tablet 77c000525583471e957c31b719d95ea0 from peer 2327d27b0bd449ea89201c0404e0915f ({username='slave'} at 127.0.0.1:32972)
I20251211 21:04:14.422634 1382 tablet_copy_service.cc:161] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Beginning new tablet copy session on tablet 77c000525583471e957c31b719d95ea0 from peer 2327d27b0bd449ea89201c0404e0915f at {username='slave'} at 127.0.0.1:32972: session id = 2327d27b0bd449ea89201c0404e0915f-77c000525583471e957c31b719d95ea0
I20251211 21:04:14.423480 1382 tablet_copy_source_session.cc:215] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:14.424226 2089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c000525583471e957c31b719d95ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:14.426210 2089 tablet_copy_client.cc:806] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:14.426357 2089 tablet_copy_client.cc:670] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:14.427567 2090 tablet_copy_client.cc:1025] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:14.472944 2061 raft_consensus.cc:993] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:14.473065 2061 raft_consensus.cc:1081] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:14.473398 1445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f04c059ecaa6400781a090ca30270262"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:14.473528 1445 raft_consensus.cc:493] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:14.473596 1445 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:14.474956 1445 raft_consensus.cc:515] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:14.475299 1445 leader_election.cc:290] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 3 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095)
I20251211 21:04:14.475557 1851 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 3 candidate_status { last_received { term: 2 index: 29 } } ignore_live_leader: true dest_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
I20251211 21:04:14.475591 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 3 candidate_status { last_received { term: 2 index: 29 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:14.475684 1851 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:14.475729 1371 raft_consensus.cc:3055] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Stepping down as leader of term 2
I20251211 21:04:14.475773 1371 raft_consensus.cc:740] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:14.475891 1371 consensus_queue.cc:260] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:14.476050 1371 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:14.476459 1851 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 3.
I20251211 21:04:14.476765 1412 leader_election.cc:304] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, aa211fd16a6744bbaa4bbb4545567bae; no voters:
I20251211 21:04:14.476809 1371 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 3.
I20251211 21:04:14.476970 2048 raft_consensus.cc:2804] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:04:14.477149 2048 raft_consensus.cc:697] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:14.477279 2048 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:14.478790 1263 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 2 to 3, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 3 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:14.488057 2097 ts_tablet_manager.cc:933] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: Initiating tablet copy from peer 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:14.488112 2098 ts_tablet_manager.cc:933] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: Initiating tablet copy from peer 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:14.488493 2097 tablet_copy_client.cc:323] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:34101
I20251211 21:04:14.488703 2098 tablet_copy_client.cc:323] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:34101
I20251211 21:04:14.488873 1458 tablet_copy_service.cc:140] P 22f0fcdd6d614884843d6ef3bca6708f: Received BeginTabletCopySession request for tablet c94dc3e2fd5d4db3aa515604c847331f from peer f5074d327f094246ad9acb355421d061 ({username='slave'} at 127.0.0.1:46506)
I20251211 21:04:14.488962 1458 tablet_copy_service.cc:161] P 22f0fcdd6d614884843d6ef3bca6708f: Beginning new tablet copy session on tablet c94dc3e2fd5d4db3aa515604c847331f from peer f5074d327f094246ad9acb355421d061 at {username='slave'} at 127.0.0.1:46506: session id = f5074d327f094246ad9acb355421d061-c94dc3e2fd5d4db3aa515604c847331f
I20251211 21:04:14.489413 1457 tablet_copy_service.cc:140] P 22f0fcdd6d614884843d6ef3bca6708f: Received BeginTabletCopySession request for tablet 70e1f34692834e4cb9ffbdbbbc356141 from peer aa211fd16a6744bbaa4bbb4545567bae ({username='slave'} at 127.0.0.1:58108)
I20251211 21:04:14.489509 1457 tablet_copy_service.cc:161] P 22f0fcdd6d614884843d6ef3bca6708f: Beginning new tablet copy session on tablet 70e1f34692834e4cb9ffbdbbbc356141 from peer aa211fd16a6744bbaa4bbb4545567bae at {username='slave'} at 127.0.0.1:58108: session id = aa211fd16a6744bbaa4bbb4545567bae-70e1f34692834e4cb9ffbdbbbc356141
I20251211 21:04:14.489806 1458 tablet_copy_source_session.cc:215] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:14.490247 1457 tablet_copy_source_session.cc:215] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:14.490516 2097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94dc3e2fd5d4db3aa515604c847331f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:14.491005 2098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e1f34692834e4cb9ffbdbbbc356141. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:14.492651 2097 tablet_copy_client.cc:806] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:14.492805 2097 tablet_copy_client.cc:670] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:14.492977 2098 tablet_copy_client.cc:806] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:14.493122 2098 tablet_copy_client.cc:670] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:14.493677 2099 tablet_copy_client.cc:1025] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:14.494136 2100 tablet_copy_client.cc:1025] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:14.497350 2091 raft_consensus.cc:993] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:14.497457 2061 raft_consensus.cc:1081] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:14.497830 1445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:14.497946 1445 raft_consensus.cc:493] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:14.498000 1445 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.498800 1445 raft_consensus.cc:515] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:14.499118 1445 leader_election.cc:290] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 2 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:14.499382 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:14.499485 1371 raft_consensus.cc:3055] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:14.499504 1518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:14.499534 1371 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:14.499584 1518 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.499689 1371 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 25, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:14.499879 1371 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.500552 1518 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 2.
I20251211 21:04:14.500684 1371 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 2.
I20251211 21:04:14.500921 1413 leader_election.cc:304] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:14.501147 2048 raft_consensus.cc:2804] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:14.501252 2048 raft_consensus.cc:697] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:14.501381 2048 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 25, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:14.502951 1263 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 1 to 2, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 2 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:14.508471 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:14.508587 1445 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Received request to transfer leadership
I20251211 21:04:14.513226 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:14.513353 1445 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Received request to transfer leadership
W20251211 21:04:14.513595 1253 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 9afcbdf999514a22badd7550b63d8cb8 already in progress
I20251211 21:04:14.514317 1443 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:14.514410 1443 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Received request to transfer leadership
W20251211 21:04:14.514681 1317 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for 9afcbdf999514a22badd7550b63d8cb8 already in progress
W20251211 21:04:14.514729 1317 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 9afcbdf999514a22badd7550b63d8cb8 already in progress
I20251211 21:04:14.685173 1994 raft_consensus.cc:993] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:14.685288 1994 raft_consensus.cc:1081] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:14.685681 1371 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40790
I20251211 21:04:14.685837 1371 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:14.685925 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.686931 1371 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:14.687307 1371 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 2 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:14.687623 1518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:14.687731 1518 raft_consensus.cc:3055] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:14.687775 1518 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:14.687906 1518 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 24, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:14.688086 1518 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.688882 1518 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 2.
I20251211 21:04:14.689147 1337 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:14.689177 1443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:14.689272 1443 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.689318 2061 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:14.689428 2061 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:14.689564 2061 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 24, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } }
I20251211 21:04:14.690181 1443 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 2.
I20251211 21:04:14.691387 1263 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 1 to 2, leader changed from 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 2 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:14.751308 2102 raft_consensus.cc:993] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:14.751425 2102 raft_consensus.cc:1081] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:14.751859 1445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58080
I20251211 21:04:14.752003 1445 raft_consensus.cc:493] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:14.752072 1445 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.753123 1445 raft_consensus.cc:515] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:14.753484 1445 leader_election.cc:290] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 2 election: Requested vote from peers 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:14.753732 1774 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:14.753749 1518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:14.753891 1774 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.753911 1518 raft_consensus.cc:3055] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:14.753965 1518 raft_consensus.cc:740] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:14.754107 1518 consensus_queue.cc:260] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:14.754278 1518 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.754731 1774 raft_consensus.cc:2468] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 2.
I20251211 21:04:14.754997 1412 leader_election.cc:304] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2327d27b0bd449ea89201c0404e0915f; no voters:
I20251211 21:04:14.755044 1518 raft_consensus.cc:2468] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 2.
I20251211 21:04:14.755146 2048 raft_consensus.cc:2804] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:14.755224 2048 raft_consensus.cc:697] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:14.755340 2048 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:14.756973 1263 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 1 to 2, leader changed from 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 2 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:14.863023 1851 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251211 21:04:14.863409 2092 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:14.865792 1371 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251211 21:04:14.866120 2092 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:14.891173 1518 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:14.891706 2092 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:14.892930 2048 raft_consensus.cc:993] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower 5eec57358d0f4ba48d683b4c7d445454 to start an election
I20251211 21:04:14.893014 2048 raft_consensus.cc:1081] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Signalling peer 5eec57358d0f4ba48d683b4c7d445454 to start an election
I20251211 21:04:14.893832 1371 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:14.893867 1521 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
from {username='slave'} at 127.0.0.1:56262
I20251211 21:04:14.894431 1521 raft_consensus.cc:493] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:14.894505 1521 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:14.894712 2048 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:14.895581 1521 raft_consensus.cc:515] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:14.896073 1521 leader_election.cc:290] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 3 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:14.896334 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 3 candidate_status { last_received { term: 2 index: 26 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:14.896430 1445 raft_consensus.cc:3055] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Stepping down as leader of term 2
I20251211 21:04:14.896472 1445 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:14.896592 1445 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 2.26, Last appended by leader: 26, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:14.896723 1370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 3 candidate_status { last_received { term: 2 index: 26 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:14.896864 1370 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:14.897701 1370 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 3.
W20251211 21:04:14.894256 1412 consensus_peers.cc:597] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f -> Peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747): Couldn't send request to peer 2327d27b0bd449ea89201c0404e0915f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:14.898025 1486 leader_election.cc:304] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:14.898303 2102 raft_consensus.cc:2804] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:04:14.898398 2102 raft_consensus.cc:697] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Becoming Leader. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:14.898530 2102 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 2.26, Last appended by leader: 26, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:14.899576 1445 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:14.900111 1266 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: term changed from 2 to 3, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195). New cstate: current_term: 3 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:14.900561 1445 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 3.
I20251211 21:04:14.902325 2048 raft_consensus.cc:993] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower 2327d27b0bd449ea89201c0404e0915f to start an election
I20251211 21:04:14.902413 2048 raft_consensus.cc:1081] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Signalling peer 2327d27b0bd449ea89201c0404e0915f to start an election
I20251211 21:04:14.902753 1774 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2e0e0cc37a5b41fd90c461aff17e8d28"
dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
from {username='slave'} at 127.0.0.1:39462
I20251211 21:04:14.902855 1774 raft_consensus.cc:493] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:14.902913 1774 raft_consensus.cc:3060] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.903744 1774 raft_consensus.cc:515] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:14.904179 1774 leader_election.cc:290] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [CANDIDATE]: Term 2 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:14.904410 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e0e0cc37a5b41fd90c461aff17e8d28" candidate_uuid: "2327d27b0bd449ea89201c0404e0915f" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:14.904513 1445 raft_consensus.cc:3055] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:14.904561 1445 raft_consensus.cc:740] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:14.904565 1521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e0e0cc37a5b41fd90c461aff17e8d28" candidate_uuid: "2327d27b0bd449ea89201c0404e0915f" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:14.904660 1521 raft_consensus.cc:3060] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.904693 1445 consensus_queue.cc:260] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:14.904846 1445 raft_consensus.cc:3060] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.905557 1521 raft_consensus.cc:2468] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2327d27b0bd449ea89201c0404e0915f in term 2.
I20251211 21:04:14.905601 1445 raft_consensus.cc:2468] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2327d27b0bd449ea89201c0404e0915f in term 2.
I20251211 21:04:14.905810 1738 leader_election.cc:304] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2327d27b0bd449ea89201c0404e0915f; no voters:
I20251211 21:04:14.906332 2113 raft_consensus.cc:2804] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:14.906486 2113 raft_consensus.cc:697] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEADER]: Becoming Leader. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Running, Role: LEADER
I20251211 21:04:14.906612 2113 consensus_queue.cc:237] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:14.907924 1263 catalog_manager.cc:5654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f reported cstate change: term changed from 1 to 2, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to 2327d27b0bd449ea89201c0404e0915f (127.29.190.196). New cstate: current_term: 2 leader_uuid: "2327d27b0bd449ea89201c0404e0915f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:14.927784 2048 raft_consensus.cc:993] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower aa211fd16a6744bbaa4bbb4545567bae to start an election
I20251211 21:04:14.927920 2048 raft_consensus.cc:1081] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Signalling peer aa211fd16a6744bbaa4bbb4545567bae to start an election
I20251211 21:04:14.928277 1851 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c94dc3e2fd5d4db3aa515604c847331f"
dest_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
from {username='slave'} at 127.0.0.1:46958
I20251211 21:04:14.928409 1851 raft_consensus.cc:493] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:14.928473 1851 raft_consensus.cc:3060] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.929263 1851 raft_consensus.cc:515] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:14.929672 1851 leader_election.cc:290] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [CANDIDATE]: Term 2 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:14.930004 1443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c94dc3e2fd5d4db3aa515604c847331f" candidate_uuid: "aa211fd16a6744bbaa4bbb4545567bae" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:14.930109 1443 raft_consensus.cc:3055] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:14.930148 1443 raft_consensus.cc:740] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:14.930260 1443 consensus_queue.cc:260] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 29, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:14.930419 1370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c94dc3e2fd5d4db3aa515604c847331f" candidate_uuid: "aa211fd16a6744bbaa4bbb4545567bae" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:14.930441 1443 raft_consensus.cc:3060] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.930517 1370 raft_consensus.cc:3060] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:14.931394 1443 raft_consensus.cc:2468] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa211fd16a6744bbaa4bbb4545567bae in term 2.
I20251211 21:04:14.931394 1370 raft_consensus.cc:2468] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa211fd16a6744bbaa4bbb4545567bae in term 2.
I20251211 21:04:14.931699 1814 leader_election.cc:304] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, aa211fd16a6744bbaa4bbb4545567bae; no voters:
I20251211 21:04:14.931883 2105 raft_consensus.cc:2804] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:14.932050 2105 raft_consensus.cc:697] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEADER]: Becoming Leader. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Running, Role: LEADER
I20251211 21:04:14.932180 2105 consensus_queue.cc:237] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 29, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:14.933622 1263 catalog_manager.cc:5654] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae reported cstate change: term changed from 1 to 2, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197). New cstate: current_term: 2 leader_uuid: "aa211fd16a6744bbaa4bbb4545567bae" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:15.201174 1521 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:15.201552 2048 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:15.203562 1774 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:15.203948 2108 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:15.267531 1445 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 2 index: 25. (index mismatch)
I20251211 21:04:15.267783 1521 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 2 index: 25. (index mismatch)
I20251211 21:04:15.267932 2116 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20251211 21:04:15.268122 2061 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
W20251211 21:04:15.288866 1487 consensus_peers.cc:597] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 -> Peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747): Couldn't send request to peer 2327d27b0bd449ea89201c0404e0915f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:15.345865 1443 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 3 index: 27. (index mismatch)
I20251211 21:04:15.346230 1994 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:15.348151 1370 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 3 index: 27. (index mismatch)
I20251211 21:04:15.348631 2125 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:15.370609 1521 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:15.371021 2113 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:15.373853 1443 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:15.374204 2113 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
W20251211 21:04:15.389003 1815 consensus_peers.cc:597] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae -> Peer f5074d327f094246ad9acb355421d061 (127.29.190.198:40183): Couldn't send request to peer f5074d327f094246ad9acb355421d061. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:15.433225 1370 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251211 21:04:15.433647 2105 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:15.436949 1443 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251211 21:04:15.437543 2134 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:16.303231 2077 tablet_copy_client.cc:538] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:16.304986 2077 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: Bootstrap starting.
I20251211 21:04:16.329049 2077 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: Bootstrap replayed 1/1 log segments. Stats: ops{read=27 overwritten=0 applied=27 ignored=0} inserts{seen=117 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:16.329421 2077 tablet_bootstrap.cc:492] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: Bootstrap complete.
I20251211 21:04:16.329638 2077 ts_tablet_manager.cc:1403] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: Time spent bootstrapping tablet: real 0.025s user 0.024s sys 0.000s
I20251211 21:04:16.330195 2077 raft_consensus.cc:359] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.330343 2077 raft_consensus.cc:740] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f5074d327f094246ad9acb355421d061, State: Initialized, Role: LEARNER
I20251211 21:04:16.330459 2077 consensus_queue.cc:260] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 27, Last appended: 2.27, Last appended by leader: 27, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.330857 2077 ts_tablet_manager.cc:1434] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251211 21:04:16.331389 1457 tablet_copy_service.cc:342] P 22f0fcdd6d614884843d6ef3bca6708f: Request end of tablet copy session f5074d327f094246ad9acb355421d061-9b336d873366440aa05f76b89a75710a received from {username='slave'} at 127.0.0.1:46506
I20251211 21:04:16.331485 1457 tablet_copy_service.cc:434] P 22f0fcdd6d614884843d6ef3bca6708f: ending tablet copy session f5074d327f094246ad9acb355421d061-9b336d873366440aa05f76b89a75710a on tablet 9b336d873366440aa05f76b89a75710a with peer f5074d327f094246ad9acb355421d061
I20251211 21:04:16.371965 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:16.373463 1926 raft_consensus.cc:1217] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.26->[2.27-2.27] Dedup: 2.27->[]
I20251211 21:04:16.373880 1370 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:16.374032 1370 raft_consensus.cc:606] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:16.374727 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "5eec57358d0f4ba48d683b4c7d445454"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:16.374845 1445 raft_consensus.cc:606] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Received request to transfer leadership to TS 5eec57358d0f4ba48d683b4c7d445454
I20251211 21:04:16.375944 1521 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:43430
I20251211 21:04:16.376056 1521 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:16.376786 1443 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:16.376889 1443 raft_consensus.cc:606] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:16.377142 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20251211 21:04:16.377261 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:16.377512 2083 tablet_copy_client.cc:538] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:16.378901 2083 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap starting.
I20251211 21:04:16.398553 2083 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap replayed 1/1 log segments. Stats: ops{read=25 overwritten=0 applied=25 ignored=0} inserts{seen=107 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:16.398844 2083 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap complete.
I20251211 21:04:16.399062 2083 ts_tablet_manager.cc:1403] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: Time spent bootstrapping tablet: real 0.020s user 0.018s sys 0.000s
I20251211 21:04:16.399580 2083 raft_consensus.cc:359] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:16.399734 2083 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Initialized, Role: LEARNER
I20251211 21:04:16.399869 2083 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 25, Last appended: 1.25, Last appended by leader: 25, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:16.400157 2083 ts_tablet_manager.cc:1434] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: Time spent starting tablet: real 0.001s user 0.001s sys 0.003s
I20251211 21:04:16.400575 1382 tablet_copy_service.cc:342] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Request end of tablet copy session 2327d27b0bd449ea89201c0404e0915f-9afcbdf999514a22badd7550b63d8cb8 received from {username='slave'} at 127.0.0.1:32972
I20251211 21:04:16.400655 1382 tablet_copy_service.cc:434] P 2d3e56eb6a174c3eb932f4bcdc62e18c: ending tablet copy session 2327d27b0bd449ea89201c0404e0915f-9afcbdf999514a22badd7550b63d8cb8 on tablet 9afcbdf999514a22badd7550b63d8cb8 with peer 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:16.406064 2108 raft_consensus.cc:993] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:16.406164 2108 raft_consensus.cc:1081] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:16.406519 1371 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40782
I20251211 21:04:16.406634 1371 raft_consensus.cc:493] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:16.406697 1371 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:16.407658 1371 raft_consensus.cc:515] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.408020 1371 leader_election.cc:290] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 3 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:16.408257 1443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 27 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:16.408254 1521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 27 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:16.408396 1443 raft_consensus.cc:3055] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Stepping down as leader of term 2
I20251211 21:04:16.408396 1521 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:16.408449 1443 raft_consensus.cc:740] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:16.408574 1443 consensus_queue.cc:260] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 27, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.408751 1443 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:16.409435 1521 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 3.
I20251211 21:04:16.409612 1443 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 3.
I20251211 21:04:16.409659 1337 leader_election.cc:304] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:16.409826 2091 raft_consensus.cc:2804] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:04:16.410007 2091 raft_consensus.cc:697] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:16.410140 2091 consensus_queue.cc:237] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 27, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.411957 2086 tablet_copy_client.cc:538] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:16.412362 1266 catalog_manager.cc:5654] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 2 to 3, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 3 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:16.413295 2086 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap starting.
I20251211 21:04:16.418938 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:16.419063 1371 raft_consensus.cc:606] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 LEADER]: Received request to transfer leadership
I20251211 21:04:16.423394 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:16.423538 1371 raft_consensus.cc:606] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 LEADER]: Received request to transfer leadership
I20251211 21:04:16.424435 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:16.424542 1371 raft_consensus.cc:606] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 LEADER]: Received request to transfer leadership
W20251211 21:04:16.424836 1317 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for 9b336d873366440aa05f76b89a75710a already in progress
W20251211 21:04:16.424886 1317 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 9b336d873366440aa05f76b89a75710a already in progress
I20251211 21:04:16.427851 2089 tablet_copy_client.cc:538] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:16.429239 2089 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap starting.
I20251211 21:04:16.435837 2086 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=102 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:16.436167 2086 tablet_bootstrap.cc:492] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap complete.
I20251211 21:04:16.436409 2086 ts_tablet_manager.cc:1403] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: Time spent bootstrapping tablet: real 0.023s user 0.023s sys 0.000s
I20251211 21:04:16.436935 2086 raft_consensus.cc:359] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:16.437095 2086 raft_consensus.cc:740] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Initialized, Role: LEARNER
I20251211 21:04:16.437238 2086 consensus_queue.cc:260] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:16.437674 2086 ts_tablet_manager.cc:1434] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:16.438686 1382 tablet_copy_service.cc:342] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Request end of tablet copy session aa211fd16a6744bbaa4bbb4545567bae-605e369cbf1b4052b066b230cc165bb7 received from {username='slave'} at 127.0.0.1:32976
I20251211 21:04:16.438762 1382 tablet_copy_service.cc:434] P 2d3e56eb6a174c3eb932f4bcdc62e18c: ending tablet copy session aa211fd16a6744bbaa4bbb4545567bae-605e369cbf1b4052b066b230cc165bb7 on tablet 605e369cbf1b4052b066b230cc165bb7 with peer aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:16.450790 2089 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=87 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:16.451102 2089 tablet_bootstrap.cc:492] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap complete.
I20251211 21:04:16.451284 2089 ts_tablet_manager.cc:1403] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: Time spent bootstrapping tablet: real 0.022s user 0.019s sys 0.000s
I20251211 21:04:16.451869 2089 raft_consensus.cc:359] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:16.451978 2089 raft_consensus.cc:740] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Initialized, Role: LEARNER
I20251211 21:04:16.452054 2089 consensus_queue.cc:260] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:16.452307 2089 ts_tablet_manager.cc:1434] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:16.452785 1382 tablet_copy_service.cc:342] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Request end of tablet copy session 2327d27b0bd449ea89201c0404e0915f-77c000525583471e957c31b719d95ea0 received from {username='slave'} at 127.0.0.1:32972
I20251211 21:04:16.452865 1382 tablet_copy_service.cc:434] P 2d3e56eb6a174c3eb932f4bcdc62e18c: ending tablet copy session 2327d27b0bd449ea89201c0404e0915f-77c000525583471e957c31b719d95ea0 on tablet 77c000525583471e957c31b719d95ea0 with peer 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:16.492866 1774 raft_consensus.cc:1217] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.25->[1.26-1.26] Dedup: 1.26->[]
I20251211 21:04:16.494496 2097 tablet_copy_client.cc:538] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:16.494365 2098 tablet_copy_client.cc:538] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:16.495872 2098 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap starting.
I20251211 21:04:16.495872 2097 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: Bootstrap starting.
I20251211 21:04:16.504369 2091 raft_consensus.cc:993] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:16.504469 2091 raft_consensus.cc:1081] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:16.504937 1443 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:16.505087 1443 raft_consensus.cc:493] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:16.505146 1443 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:16.506215 1443 raft_consensus.cc:515] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:16.506605 1443 leader_election.cc:290] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 2 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:16.506834 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:16.506844 1521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:16.506964 1371 raft_consensus.cc:3055] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:16.506971 1521 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:16.507019 1371 raft_consensus.cc:740] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:16.507150 1371 consensus_queue.cc:260] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:16.507331 1371 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:16.507864 1521 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 2.
I20251211 21:04:16.508144 1413 leader_election.cc:304] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:16.508284 1371 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 2.
I20251211 21:04:16.508306 2108 raft_consensus.cc:2804] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:16.508381 2108 raft_consensus.cc:697] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:16.508502 2108 consensus_queue.cc:237] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:16.510111 1266 catalog_manager.cc:5654] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 1 to 2, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 2 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:16.519229 2097 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: Bootstrap replayed 1/1 log segments. Stats: ops{read=29 overwritten=0 applied=29 ignored=0} inserts{seen=95 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:16.519760 2098 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=101 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:16.519934 2097 tablet_bootstrap.cc:492] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: Bootstrap complete.
I20251211 21:04:16.520076 2098 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap complete.
I20251211 21:04:16.520153 2097 ts_tablet_manager.cc:1403] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: Time spent bootstrapping tablet: real 0.024s user 0.022s sys 0.001s
I20251211 21:04:16.520280 2098 ts_tablet_manager.cc:1403] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: Time spent bootstrapping tablet: real 0.024s user 0.019s sys 0.004s
I20251211 21:04:16.520634 2097 raft_consensus.cc:359] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.520759 2097 raft_consensus.cc:740] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5074d327f094246ad9acb355421d061, State: Initialized, Role: LEARNER
I20251211 21:04:16.520907 2097 consensus_queue.cc:260] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 29, Last appended: 1.29, Last appended by leader: 29, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.520963 2098 raft_consensus.cc:359] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:16.521212 2097 ts_tablet_manager.cc:1434] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:16.521085 2098 raft_consensus.cc:740] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Initialized, Role: LEARNER
I20251211 21:04:16.521553 2098 consensus_queue.cc:260] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:16.521641 1457 tablet_copy_service.cc:342] P 22f0fcdd6d614884843d6ef3bca6708f: Request end of tablet copy session f5074d327f094246ad9acb355421d061-c94dc3e2fd5d4db3aa515604c847331f received from {username='slave'} at 127.0.0.1:46506
I20251211 21:04:16.521714 1457 tablet_copy_service.cc:434] P 22f0fcdd6d614884843d6ef3bca6708f: ending tablet copy session f5074d327f094246ad9acb355421d061-c94dc3e2fd5d4db3aa515604c847331f on tablet c94dc3e2fd5d4db3aa515604c847331f with peer f5074d327f094246ad9acb355421d061
I20251211 21:04:16.521842 2098 ts_tablet_manager.cc:1434] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:16.522707 1457 tablet_copy_service.cc:342] P 22f0fcdd6d614884843d6ef3bca6708f: Request end of tablet copy session aa211fd16a6744bbaa4bbb4545567bae-70e1f34692834e4cb9ffbdbbbc356141 received from {username='slave'} at 127.0.0.1:58108
I20251211 21:04:16.522778 1457 tablet_copy_service.cc:434] P 22f0fcdd6d614884843d6ef3bca6708f: ending tablet copy session aa211fd16a6744bbaa4bbb4545567bae-70e1f34692834e4cb9ffbdbbbc356141 on tablet 70e1f34692834e4cb9ffbdbbbc356141 with peer aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:16.798859 1774 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Advancing to term 3
I20251211 21:04:16.799952 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 3 LEARNER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:16.800299 1994 consensus_queue.cc:1050] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:16.802085 1994 raft_consensus.cc:1064] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: attempting to promote NON_VOTER 2327d27b0bd449ea89201c0404e0915f to VOTER
W20251211 21:04:16.802165 1994 raft_consensus.cc:1067] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Unable to promote non-voter 2327d27b0bd449ea89201c0404e0915f: Service unavailable: leader transfer in progress
I20251211 21:04:16.816932 2140 raft_consensus.cc:993] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower 5eec57358d0f4ba48d683b4c7d445454 to start an election
I20251211 21:04:16.817061 2140 raft_consensus.cc:1081] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Signalling peer 5eec57358d0f4ba48d683b4c7d445454 to start an election
I20251211 21:04:16.817456 1521 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
from {username='slave'} at 127.0.0.1:56262
I20251211 21:04:16.817602 1521 raft_consensus.cc:493] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:16.817668 1521 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:16.818740 1521 raft_consensus.cc:515] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:16.819126 1521 leader_election.cc:290] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 3 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:16.819321 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 3 candidate_status { last_received { term: 2 index: 29 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:16.819420 1445 raft_consensus.cc:3055] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Stepping down as leader of term 2
I20251211 21:04:16.819459 1445 raft_consensus.cc:740] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:16.819542 1774 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d55fcc7df346549c84ae6cfdcf36ad" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 3 candidate_status { last_received { term: 2 index: 29 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:16.819644 1774 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:16.820631 1774 raft_consensus.cc:2468] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 3.
I20251211 21:04:16.819639 1445 consensus_queue.cc:260] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:16.820879 1487 leader_election.cc:304] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2327d27b0bd449ea89201c0404e0915f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:16.821022 1445 raft_consensus.cc:3060] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:16.821087 2156 raft_consensus.cc:2804] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:04:16.821368 2156 raft_consensus.cc:697] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Becoming Leader. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:16.821523 2156 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:16.822192 1445 raft_consensus.cc:2468] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 3.
I20251211 21:04:16.823014 1263 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: term changed from 2 to 3, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195). New cstate: current_term: 3 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:16.836896 1994 raft_consensus.cc:993] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:16.837040 2156 raft_consensus.cc:1081] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:16.837505 1370 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40790
I20251211 21:04:16.837656 1370 raft_consensus.cc:493] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:16.837739 1370 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:16.838641 1370 raft_consensus.cc:515] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:16.839016 1370 leader_election.cc:290] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 4 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:16.839309 1521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 27 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:16.839416 1521 raft_consensus.cc:3055] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Stepping down as leader of term 3
I20251211 21:04:16.839463 1521 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:16.839594 1521 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 3.27, Last appended by leader: 27, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:16.839707 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 27 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:16.839828 1445 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:16.839831 1521 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:16.840644 1443 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 3 index: 28. (index mismatch)
I20251211 21:04:16.840811 1445 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 4.
I20251211 21:04:16.840986 2141 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:16.841049 1335 leader_election.cc:304] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:16.841182 2091 raft_consensus.cc:2804] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Leader election won for term 4
I20251211 21:04:16.841249 2091 raft_consensus.cc:697] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:16.841358 2091 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 3.27, Last appended by leader: 27, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:16.842984 1263 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 3 to 4, leader changed from 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 4 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:16.845631 1521 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 4.
I20251211 21:04:16.846387 2141 raft_consensus.cc:993] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:16.846514 2091 raft_consensus.cc:1081] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:16.847364 1443 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:16.847479 1443 raft_consensus.cc:493] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:16.847543 1443 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:16.847673 1521 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 3 index: 28. (index mismatch)
I20251211 21:04:16.848129 2141 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:16.848608 1443 raft_consensus.cc:515] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.848961 1443 leader_election.cc:290] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 4 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:16.849323 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 4 candidate_status { last_received { term: 3 index: 28 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:16.849426 1371 raft_consensus.cc:3055] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 LEADER]: Stepping down as leader of term 3
I20251211 21:04:16.849470 1371 raft_consensus.cc:740] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:16.849586 1371 consensus_queue.cc:260] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 3.28, Last appended by leader: 28, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.849706 1371 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:16.850648 1371 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 4.
I20251211 21:04:16.850939 1411 leader_election.cc:304] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:16.851115 2140 raft_consensus.cc:2804] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Leader election won for term 4
I20251211 21:04:16.851192 2140 raft_consensus.cc:697] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:16.851316 2140 consensus_queue.cc:237] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 3.28, Last appended by leader: 28, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:16.851846 1521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 4 candidate_status { last_received { term: 3 index: 28 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:16.851946 1521 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:16.852919 1521 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 4.
I20251211 21:04:16.853310 1263 catalog_manager.cc:5654] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 3 to 4, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 4 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:16.854157 1445 raft_consensus.cc:1240] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 LEADER]: Rejecting Update request from peer 2d3e56eb6a174c3eb932f4bcdc62e18c for earlier term 3. Current term is 4. Ops: []
I20251211 21:04:16.855221 1926 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Advancing to term 3
I20251211 21:04:16.856143 1926 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 3 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 3 index: 28. (index mismatch)
I20251211 21:04:16.880935 2091 raft_consensus.cc:1064] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: attempting to promote NON_VOTER 2327d27b0bd449ea89201c0404e0915f to VOTER
I20251211 21:04:16.881207 1851 raft_consensus.cc:1217] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Deduplicated request from leader. Original: 1.25->[1.26-1.26] Dedup: 1.26->[]
I20251211 21:04:16.881372 2091 consensus_queue.cc:237] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:16.882740 1521 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:16.882740 1774 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:16.883010 1445 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:16.883219 2167 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:16.883371 2141 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:16.883543 2161 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:16.885601 2161 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:16.886184 1774 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:16.886385 1445 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:16.887516 1521 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:16.888667 1263 catalog_manager.cc:5654] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:16.891965 1371 consensus_queue.cc:237] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:16.892984 1774 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:16.893033 1521 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:16.893288 2167 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:16.893455 2141 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:16.894778 2141 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:16.895311 1521 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:16.895354 1774 raft_consensus.cc:2955] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:16.896806 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 77c000525583471e957c31b719d95ea0 with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:16.897140 1261 catalog_manager.cc:5654] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 27 to 28, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New cstate: current_term: 1 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:16.899547 1433 tablet_service.cc:1552] Processing DeleteTablet for tablet 77c000525583471e957c31b719d95ea0 with delete_type TABLET_DATA_TOMBSTONED (TS 22f0fcdd6d614884843d6ef3bca6708f not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:16.900166 2171 tablet_replica.cc:333] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:16.900303 2171 raft_consensus.cc:2243] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:16.900470 2171 raft_consensus.cc:2272] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:16.901324 2171 ts_tablet_manager.cc:1916] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:16.903178 2171 ts_tablet_manager.cc:1929] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.27
I20251211 21:04:16.903240 2171 log.cc:1199] T 77c000525583471e957c31b719d95ea0 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/77c000525583471e957c31b719d95ea0
I20251211 21:04:16.903676 1253 catalog_manager.cc:4985] TS 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101): tablet 77c000525583471e957c31b719d95ea0 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:16.906097 1851 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Advancing to term 2
I20251211 21:04:16.906997 1851 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:16.907342 2108 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:16.909318 2108 raft_consensus.cc:1064] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
W20251211 21:04:16.909394 2108 raft_consensus.cc:1067] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: Unable to promote non-voter aa211fd16a6744bbaa4bbb4545567bae: Illegal state: Leader has not yet committed an operation in its own term
I20251211 21:04:16.933804 1371 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:16.934160 2140 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:16.937160 1521 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:16.937536 2175 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:16.938616 2140 raft_consensus.cc:1064] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
I20251211 21:04:16.938977 2140 consensus_queue.cc:237] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 26, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:16.940085 1850 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:16.940088 1521 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:16.940454 2108 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:16.940675 2108 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:16.941924 1371 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:16.942296 2108 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:16.943215 1521 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:16.942504 2175 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Committing config change with OpId 2.28: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:16.944881 1371 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:16.945082 1266 catalog_manager.cc:5654] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:16.946393 1850 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 26 to 28, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:16.948902 1445 consensus_queue.cc:237] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 2.28, Last appended by leader: 26, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:16.949841 1850 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:16.949916 1371 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:16.950202 2175 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:16.950364 2178 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:16.951692 2140 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Committing config change with OpId 2.29: config changed from index 28 to 29, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:16.952167 1851 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Committing config change with OpId 2.29: config changed from index 28 to 29, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:16.953019 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 605e369cbf1b4052b066b230cc165bb7 with cas_config_opid_index 28: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:16.953341 1371 raft_consensus.cc:2955] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Committing config change with OpId 2.29: config changed from index 28 to 29, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:16.953987 1266 catalog_manager.cc:5654] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 28 to 29, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New cstate: current_term: 2 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:16.956115 1509 tablet_service.cc:1552] Processing DeleteTablet for tablet 605e369cbf1b4052b066b230cc165bb7 with delete_type TABLET_DATA_TOMBSTONED (TS 5eec57358d0f4ba48d683b4c7d445454 not found in new config with opid_index 29) from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:16.956413 2179 tablet_replica.cc:333] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:16.956545 2179 raft_consensus.cc:2243] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:16.956683 2179 raft_consensus.cc:2272] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:16.957396 2179 ts_tablet_manager.cc:1916] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:16.959261 2179 ts_tablet_manager.cc:1929] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.28
I20251211 21:04:16.959323 2179 log.cc:1199] T 605e369cbf1b4052b066b230cc165bb7 P 5eec57358d0f4ba48d683b4c7d445454: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/605e369cbf1b4052b066b230cc165bb7
I20251211 21:04:16.959761 1255 catalog_manager.cc:4985] TS 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051): tablet 605e369cbf1b4052b066b230cc165bb7 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:16.974309 1926 raft_consensus.cc:3060] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Advancing to term 2
I20251211 21:04:17.239675 1521 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 27. Preceding OpId from leader: term: 4 index: 28. (index mismatch)
I20251211 21:04:17.240090 2161 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:17.242147 1774 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 3 LEARNER]: Advancing to term 4
I20251211 21:04:17.243301 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 4 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 27. Preceding OpId from leader: term: 4 index: 28. (index mismatch)
I20251211 21:04:17.244318 2161 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:17.244518 1445 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 27. Preceding OpId from leader: term: 4 index: 28. (index mismatch)
I20251211 21:04:17.245407 2161 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:17.247084 2161 raft_consensus.cc:1064] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: attempting to promote NON_VOTER 2327d27b0bd449ea89201c0404e0915f to VOTER
I20251211 21:04:17.247437 2161 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 4.28, Last appended by leader: 27, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:17.248600 1521 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 28. Preceding OpId from leader: term: 4 index: 29. (index mismatch)
I20251211 21:04:17.248700 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 4 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 28. Preceding OpId from leader: term: 4 index: 29. (index mismatch)
I20251211 21:04:17.248920 2141 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:17.249502 1445 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 28. Preceding OpId from leader: term: 4 index: 29. (index mismatch)
I20251211 21:04:17.249581 2141 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:17.249909 2141 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:17.250972 2091 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Committing config change with OpId 4.29: config changed from index 25 to 29, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:17.251302 1774 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Committing config change with OpId 4.29: config changed from index 25 to 29, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:17.253283 1266 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f reported cstate change: config changed from index 25 to 29, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:17.253741 1521 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Committing config change with OpId 4.29: config changed from index 25 to 29, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:17.253908 1443 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Committing config change with OpId 4.29: config changed from index 25 to 29, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:17.257164 1371 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 4.29, Last appended by leader: 27, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:17.258107 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 29. Preceding OpId from leader: term: 4 index: 30. (index mismatch)
I20251211 21:04:17.258257 1521 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 29. Preceding OpId from leader: term: 4 index: 30. (index mismatch)
I20251211 21:04:17.258831 2161 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:17.259049 2141 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:17.260447 2091 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Committing config change with OpId 4.30: config changed from index 29 to 30, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:17.260759 1774 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Committing config change with OpId 4.30: config changed from index 29 to 30, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:17.261715 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 9afcbdf999514a22badd7550b63d8cb8 with cas_config_opid_index 29: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:17.261791 1521 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Committing config change with OpId 4.30: config changed from index 29 to 30, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:17.262327 1263 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 29 to 30, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New cstate: current_term: 4 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:17.264808 1433 tablet_service.cc:1552] Processing DeleteTablet for tablet 9afcbdf999514a22badd7550b63d8cb8 with delete_type TABLET_DATA_TOMBSTONED (TS 22f0fcdd6d614884843d6ef3bca6708f not found in new config with opid_index 30) from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:17.265005 2171 tablet_replica.cc:333] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:17.265163 2171 raft_consensus.cc:2243] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:17.265313 2171 raft_consensus.cc:2272] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:17.265913 2171 ts_tablet_manager.cc:1916] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:17.268016 2171 ts_tablet_manager.cc:1929] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.29
I20251211 21:04:17.268105 2171 log.cc:1199] T 9afcbdf999514a22badd7550b63d8cb8 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/9afcbdf999514a22badd7550b63d8cb8
I20251211 21:04:17.268285 1774 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251211 21:04:17.268591 1253 catalog_manager.cc:4985] TS 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101): tablet 9afcbdf999514a22badd7550b63d8cb8 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:17.268592 1994 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:17.270541 1445 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251211 21:04:17.270890 1994 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:17.331553 1926 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 3 LEARNER]: Advancing to term 4
I20251211 21:04:17.332518 1926 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 4 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 4 index: 29. (index mismatch)
I20251211 21:04:17.332897 2178 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:17.334455 2178 raft_consensus.cc:1064] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER f5074d327f094246ad9acb355421d061 to VOTER
W20251211 21:04:17.334533 2178 raft_consensus.cc:1067] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: Unable to promote non-voter f5074d327f094246ad9acb355421d061: Illegal state: Leader has not yet committed an operation in its own term
I20251211 21:04:17.373772 2134 raft_consensus.cc:1064] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: attempting to promote NON_VOTER f5074d327f094246ad9acb355421d061 to VOTER
I20251211 21:04:17.374408 2134 consensus_queue.cc:237] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 2.30, Last appended by leader: 29, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:17.375875 1926 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 2 LEARNER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251211 21:04:17.376245 1371 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251211 21:04:17.376288 2188 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:17.376649 2187 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:17.376353 1445 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251211 21:04:17.377874 2188 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:17.379060 1370 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 28. Preceding OpId from leader: term: 4 index: 29. (index mismatch)
I20251211 21:04:17.379550 2188 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEADER]: Committing config change with OpId 2.31: config changed from index 29 to 31, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.379709 2175 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:17.380203 1370 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 29 to 31, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.380402 1443 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 29 to 31, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.382614 1521 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 28. Preceding OpId from leader: term: 4 index: 29. (index mismatch)
I20251211 21:04:17.382812 1261 catalog_manager.cc:5654] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 29 to 31, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "aa211fd16a6744bbaa4bbb4545567bae" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.383273 2108 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:17.384299 1925 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 29 to 31, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.386884 1851 consensus_queue.cc:237] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 29, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:17.388100 1925 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251211 21:04:17.389474 1443 raft_consensus.cc:1275] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251211 21:04:17.389979 2188 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:17.390529 2140 raft_consensus.cc:1064] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER f5074d327f094246ad9acb355421d061 to VOTER
I20251211 21:04:17.390925 2140 consensus_queue.cc:237] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 4.29, Last appended by leader: 28, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:17.391090 2193 consensus_queue.cc:1048] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:17.392221 1521 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 4 index: 29. Preceding OpId from leader: term: 4 index: 30. (index mismatch)
I20251211 21:04:17.392321 1926 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 4 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 4 index: 29. Preceding OpId from leader: term: 4 index: 30. (index mismatch)
I20251211 21:04:17.392221 1370 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 4 index: 29. Preceding OpId from leader: term: 4 index: 30. (index mismatch)
I20251211 21:04:17.392724 2175 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:17.392902 2108 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:17.393221 2108 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:17.394950 2190 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEADER]: Committing config change with OpId 2.32: config changed from index 31 to 32, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.395248 2108 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 LEADER]: Committing config change with OpId 4.30: config changed from index 27 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.395397 1443 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.32: config changed from index 31 to 32, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.396807 1370 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Committing config change with OpId 4.30: config changed from index 27 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.397274 1925 raft_consensus.cc:2955] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Committing config change with OpId 2.32: config changed from index 31 to 32, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.397346 1261 catalog_manager.cc:5654] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 27 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:17.397931 1521 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Committing config change with OpId 4.30: config changed from index 27 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.399232 1313 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c94dc3e2fd5d4db3aa515604c847331f with cas_config_opid_index 31: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:17.400765 1260 catalog_manager.cc:5654] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 reported cstate change: config changed from index 31 to 32, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New cstate: current_term: 2 leader_uuid: "aa211fd16a6744bbaa4bbb4545567bae" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.402750 1926 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 4 FOLLOWER]: Committing config change with OpId 4.30: config changed from index 27 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.403719 1357 tablet_service.cc:1552] Processing DeleteTablet for tablet c94dc3e2fd5d4db3aa515604c847331f with delete_type TABLET_DATA_TOMBSTONED (TS 2d3e56eb6a174c3eb932f4bcdc62e18c not found in new config with opid_index 32) from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:17.404402 2195 tablet_replica.cc:333] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:17.404598 2195 raft_consensus.cc:2243] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:17.405046 2195 raft_consensus.cc:2272] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:17.405718 1443 consensus_queue.cc:237] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 4.30, Last appended by leader: 28, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:17.405922 2195 ts_tablet_manager.cc:1916] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:17.406899 1926 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 4 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 4 index: 30. Preceding OpId from leader: term: 4 index: 31. (index mismatch)
I20251211 21:04:17.406989 1521 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 4 index: 30. Preceding OpId from leader: term: 4 index: 31. (index mismatch)
I20251211 21:04:17.407274 2178 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:17.407423 2140 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:17.408810 2140 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 LEADER]: Committing config change with OpId 4.31: config changed from index 30 to 31, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.409348 2195 ts_tablet_manager.cc:1929] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.31
I20251211 21:04:17.409409 2195 log.cc:1199] T c94dc3e2fd5d4db3aa515604c847331f P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/c94dc3e2fd5d4db3aa515604c847331f
I20251211 21:04:17.409286 1926 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 4 FOLLOWER]: Committing config change with OpId 4.31: config changed from index 30 to 31, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.409314 1521 raft_consensus.cc:2955] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Committing config change with OpId 4.31: config changed from index 30 to 31, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.410398 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 9b336d873366440aa05f76b89a75710a with cas_config_opid_index 30: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:17.411298 1253 catalog_manager.cc:4985] TS 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469): tablet c94dc3e2fd5d4db3aa515604c847331f (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:17.411490 1263 catalog_manager.cc:5654] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 30 to 31, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New cstate: current_term: 4 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:17.413527 1357 tablet_service.cc:1552] Processing DeleteTablet for tablet 9b336d873366440aa05f76b89a75710a with delete_type TABLET_DATA_TOMBSTONED (TS 2d3e56eb6a174c3eb932f4bcdc62e18c not found in new config with opid_index 31) from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:17.413733 2195 tablet_replica.cc:333] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:17.413895 2195 raft_consensus.cc:2243] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:17.414077 2195 raft_consensus.cc:2272] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:17.414673 2195 ts_tablet_manager.cc:1916] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:17.416936 2195 ts_tablet_manager.cc:1929] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.30
I20251211 21:04:17.417022 2195 log.cc:1199] T 9b336d873366440aa05f76b89a75710a P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/9b336d873366440aa05f76b89a75710a
I20251211 21:04:17.417474 1253 catalog_manager.cc:4985] TS 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469): tablet 9b336d873366440aa05f76b89a75710a (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:17.441166 2140 raft_consensus.cc:1064] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
I20251211 21:04:17.441605 2140 consensus_queue.cc:237] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:17.442760 1521 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:17.443022 1370 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:17.443099 2178 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:17.443395 2108 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:17.443935 1851 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251211 21:04:17.444219 2108 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:17.445586 2108 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:17.446192 1851 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:17.446300 1521 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:17.447492 1370 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:17.448603 1260 catalog_manager.cc:5654] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 26 to 27, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:17.452142 1443 consensus_queue.cc:237] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:17.453244 1851 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:17.453341 1370 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251211 21:04:17.453580 2175 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:17.453908 2140 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:17.455132 2178 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:17.455492 1370 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:17.455796 1851 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:17.456530 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 70e1f34692834e4cb9ffbdbbbc356141 with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:17.457535 1262 catalog_manager.cc:5654] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:17.459564 1509 tablet_service.cc:1552] Processing DeleteTablet for tablet 70e1f34692834e4cb9ffbdbbbc356141 with delete_type TABLET_DATA_TOMBSTONED (TS 5eec57358d0f4ba48d683b4c7d445454 not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:17.459790 2179 tablet_replica.cc:333] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:17.459949 2179 raft_consensus.cc:2243] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:17.460101 2179 raft_consensus.cc:2272] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:17.460573 2179 ts_tablet_manager.cc:1916] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:17.462210 2179 ts_tablet_manager.cc:1929] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.27
I20251211 21:04:17.462277 2179 log.cc:1199] T 70e1f34692834e4cb9ffbdbbbc356141 P 5eec57358d0f4ba48d683b4c7d445454: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/70e1f34692834e4cb9ffbdbbbc356141
I20251211 21:04:17.462689 1255 catalog_manager.cc:4985] TS 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051): tablet 70e1f34692834e4cb9ffbdbbbc356141 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:18.377543 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:18.379207 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:18.379359 1445 raft_consensus.cc:606] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Received request to transfer leadership to TS aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:18.380187 1370 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "77c000525583471e957c31b719d95ea0"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "2327d27b0bd449ea89201c0404e0915f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:18.380306 1370 raft_consensus.cc:606] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Received request to transfer leadership to TS 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:18.381027 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "f5074d327f094246ad9acb355421d061"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:18.381136 1445 raft_consensus.cc:606] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 LEADER]: Received request to transfer leadership to TS f5074d327f094246ad9acb355421d061
I20251211 21:04:18.381776 1521 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e90566476d56419683b3518348f96603"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:43430
I20251211 21:04:18.381882 1521 raft_consensus.cc:606] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:18.382186 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20251211 21:04:18.382309 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:18.459908 2141 raft_consensus.cc:993] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 2327d27b0bd449ea89201c0404e0915f to start an election
I20251211 21:04:18.460031 2141 raft_consensus.cc:1081] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Signalling peer 2327d27b0bd449ea89201c0404e0915f to start an election
I20251211 21:04:18.460501 1774 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "77c000525583471e957c31b719d95ea0"
dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
from {username='slave'} at 127.0.0.1:38794
I20251211 21:04:18.460639 1774 raft_consensus.cc:493] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:18.460708 1774 raft_consensus.cc:3060] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:18.461462 1370 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 2.25, Last appended by leader: 24, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:18.461826 1774 raft_consensus.cc:515] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:18.462357 1774 leader_election.cc:290] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [CANDIDATE]: Term 2 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:18.462520 1521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77c000525583471e957c31b719d95ea0" candidate_uuid: "2327d27b0bd449ea89201c0404e0915f" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:18.462616 1521 raft_consensus.cc:3060] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
W20251211 21:04:18.463088 1336 consensus_peers.cc:597] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c -> Peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747): Couldn't send request to peer 2327d27b0bd449ea89201c0404e0915f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5145c85694243d88e619a1c643c6909. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:18.463156 1370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77c000525583471e957c31b719d95ea0" candidate_uuid: "2327d27b0bd449ea89201c0404e0915f" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:18.463171 1518 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:18.463253 1370 raft_consensus.cc:3055] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:18.463289 1370 raft_consensus.cc:740] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:18.463403 1370 consensus_queue.cc:260] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:18.463104 1445 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 25. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20251211 21:04:18.463538 1370 raft_consensus.cc:3060] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:18.463523 2204 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:18.463639 1521 raft_consensus.cc:2468] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2327d27b0bd449ea89201c0404e0915f in term 2.
I20251211 21:04:18.463907 1740 leader_election.cc:304] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2327d27b0bd449ea89201c0404e0915f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:18.464054 2204 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251211 21:04:18.464262 2207 raft_consensus.cc:2804] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:18.464447 2207 raft_consensus.cc:697] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEADER]: Becoming Leader. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Running, Role: LEADER
I20251211 21:04:18.464578 2207 consensus_queue.cc:237] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:18.465490 1370 raft_consensus.cc:2468] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2327d27b0bd449ea89201c0404e0915f in term 2.
I20251211 21:04:18.466043 1262 catalog_manager.cc:5654] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f reported cstate change: term changed from 1 to 2, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 2327d27b0bd449ea89201c0404e0915f (127.29.190.196). New cstate: current_term: 2 leader_uuid: "2327d27b0bd449ea89201c0404e0915f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:18.466032 2204 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Committing config change with OpId 2.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:18.466429 1445 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:18.467806 1521 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Committing config change with OpId 2.26: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:18.468528 1263 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index -1 to 26, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New cstate: current_term: 2 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:18.476162 1774 consensus_queue.cc:237] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:18.477432 1445 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251211 21:04:18.477727 1521 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251211 21:04:18.477792 2220 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:18.478093 2208 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:18.479377 2220 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEADER]: Committing config change with OpId 2.30: config changed from index 28 to 30, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:18.479799 1445 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 28 to 30, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:18.481494 1266 catalog_manager.cc:5654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f reported cstate change: config changed from index 28 to 30, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New cstate: current_term: 2 leader_uuid: "2327d27b0bd449ea89201c0404e0915f" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:18.482129 1521 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 28 to 30, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:18.482225 1445 consensus_queue.cc:237] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
W20251211 21:04:18.483351 1739 consensus_peers.cc:597] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f -> Peer aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095): Couldn't send request to peer aa211fd16a6744bbaa4bbb4545567bae. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e0e0cc37a5b41fd90c461aff17e8d28. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:18.484611 1370 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
W20251211 21:04:18.484649 1412 consensus_peers.cc:597] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f -> Peer f5074d327f094246ad9acb355421d061 (127.29.190.198:40183): Couldn't send request to peer f5074d327f094246ad9acb355421d061. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70e1f34692834e4cb9ffbdbbbc356141. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:18.484874 1851 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251211 21:04:18.485047 2140 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:18.485625 2140 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:18.486675 2140 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:18.487093 1370 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:18.487845 1851 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:18.489245 1521 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 3.30, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:18.489519 1260 catalog_manager.cc:5654] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 28 to 29, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:18.490566 1774 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 3 index: 31. (index mismatch)
W20251211 21:04:18.490705 1487 consensus_peers.cc:597] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 -> Peer f5074d327f094246ad9acb355421d061 (127.29.190.198:40183): Couldn't send request to peer f5074d327f094246ad9acb355421d061. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91d55fcc7df346549c84ae6cfdcf36ad. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:18.490868 2203 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:18.491405 1445 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 3 index: 31. (index mismatch)
I20251211 21:04:18.492151 2203 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:18.492913 2231 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Committing config change with OpId 3.31: config changed from index 28 to 31, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:18.493376 1774 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Committing config change with OpId 3.31: config changed from index 28 to 31, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:18.494994 1266 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 28 to 31, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New cstate: current_term: 3 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:18.495255 1443 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 3.30, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:18.496094 1445 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Committing config change with OpId 3.31: config changed from index 28 to 31, NON_VOTER f5074d327f094246ad9acb355421d061 (127.29.190.198) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } } }
I20251211 21:04:18.496646 1370 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 3 index: 31. (index mismatch)
I20251211 21:04:18.496872 1851 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 3 index: 31. (index mismatch)
I20251211 21:04:18.497033 2226 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:18.497192 2227 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
W20251211 21:04:18.498498 1412 consensus_peers.cc:597] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f -> Peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747): Couldn't send request to peer 2327d27b0bd449ea89201c0404e0915f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f04c059ecaa6400781a090ca30270262. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:18.498981 2226 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Committing config change with OpId 3.31: config changed from index 29 to 31, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:18.499364 1370 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Committing config change with OpId 3.31: config changed from index 29 to 31, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:18.499811 1851 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Committing config change with OpId 3.31: config changed from index 29 to 31, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } } }
I20251211 21:04:18.501444 1266 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 29 to 31, NON_VOTER 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) added. New cstate: current_term: 3 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:18.502070 1370 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 4.30, Last appended by leader: 27, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:18.503175 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 30. Preceding OpId from leader: term: 4 index: 31. (index mismatch)
I20251211 21:04:18.503819 2206 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:18.503960 1521 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 30. Preceding OpId from leader: term: 4 index: 31. (index mismatch)
W20251211 21:04:18.504036 1336 consensus_peers.cc:597] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c -> Peer aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095): Couldn't send request to peer aa211fd16a6744bbaa4bbb4545567bae. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9afcbdf999514a22badd7550b63d8cb8. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:18.504308 2206 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:18.505224 2204 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Committing config change with OpId 4.31: config changed from index 30 to 31, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:18.505596 1774 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Committing config change with OpId 4.31: config changed from index 30 to 31, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:18.506089 1521 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Committing config change with OpId 4.31: config changed from index 30 to 31, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:18.507516 1260 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f reported cstate change: config changed from index 30 to 31, NON_VOTER aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) added. New cstate: current_term: 4 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } } }
I20251211 21:04:18.746939 2203 raft_consensus.cc:993] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:18.747083 2203 raft_consensus.cc:1081] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:18.747489 1370 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e90566476d56419683b3518348f96603"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40790
I20251211 21:04:18.747651 1370 raft_consensus.cc:493] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:18.747725 1370 raft_consensus.cc:3060] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:18.748701 1370 raft_consensus.cc:515] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:18.749046 1370 leader_election.cc:290] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 2 election: Requested vote from peers 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051), f5074d327f094246ad9acb355421d061 (127.29.190.198:40183)
I20251211 21:04:18.749270 1521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e90566476d56419683b3518348f96603" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:18.749367 1521 raft_consensus.cc:3055] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:18.749408 1521 raft_consensus.cc:740] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:18.749460 1926 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e90566476d56419683b3518348f96603" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "f5074d327f094246ad9acb355421d061"
I20251211 21:04:18.749531 1521 consensus_queue.cc:260] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:18.749594 1926 raft_consensus.cc:3060] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:18.749675 1521 raft_consensus.cc:3060] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:18.750514 1521 raft_consensus.cc:2468] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 2.
I20251211 21:04:18.750607 1926 raft_consensus.cc:2468] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 2.
I20251211 21:04:18.750814 1337 leader_election.cc:304] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:18.751019 2141 raft_consensus.cc:2804] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:18.751096 2141 raft_consensus.cc:697] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:18.751214 2141 consensus_queue.cc:237] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:18.752769 1266 catalog_manager.cc:5654] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 1 to 2, leader changed from 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 2 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:18.838254 2140 raft_consensus.cc:993] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower f5074d327f094246ad9acb355421d061 to start an election
I20251211 21:04:18.838373 2140 raft_consensus.cc:1081] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 LEADER]: Signalling peer f5074d327f094246ad9acb355421d061 to start an election
I20251211 21:04:18.838760 1926 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9b336d873366440aa05f76b89a75710a"
dest_uuid: "f5074d327f094246ad9acb355421d061"
from {username='slave'} at 127.0.0.1:56680
I20251211 21:04:18.838887 1926 raft_consensus.cc:493] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:18.838951 1926 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:18.841307 1926 raft_consensus.cc:515] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:18.841835 1926 leader_election.cc:290] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [CANDIDATE]: Term 5 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:18.842257 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "f5074d327f094246ad9acb355421d061" candidate_term: 5 candidate_status { last_received { term: 4 index: 31 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:18.842379 1445 raft_consensus.cc:3055] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 LEADER]: Stepping down as leader of term 4
I20251211 21:04:18.842424 1445 raft_consensus.cc:740] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:18.842545 1445 consensus_queue.cc:260] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 4.31, Last appended by leader: 31, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:18.842686 1445 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:18.843427 1445 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5074d327f094246ad9acb355421d061 in term 5.
I20251211 21:04:18.843734 1889 leader_election.cc:304] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, f5074d327f094246ad9acb355421d061; no voters:
I20251211 21:04:18.844254 2241 raft_consensus.cc:2804] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 5 FOLLOWER]: Leader election won for term 5
I20251211 21:04:18.844488 2241 raft_consensus.cc:697] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 5 LEADER]: Becoming Leader. State: Replica: f5074d327f094246ad9acb355421d061, State: Running, Role: LEADER
I20251211 21:04:18.844630 2241 consensus_queue.cc:237] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 4.31, Last appended by leader: 31, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:18.845638 1521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9b336d873366440aa05f76b89a75710a" candidate_uuid: "f5074d327f094246ad9acb355421d061" candidate_term: 5 candidate_status { last_received { term: 4 index: 31 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:18.845805 1521 raft_consensus.cc:3060] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:18.846417 1266 catalog_manager.cc:5654] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 reported cstate change: term changed from 4 to 5, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to f5074d327f094246ad9acb355421d061 (127.29.190.198). New cstate: current_term: 5 leader_uuid: "f5074d327f094246ad9acb355421d061" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:18.846663 1521 raft_consensus.cc:2468] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5074d327f094246ad9acb355421d061 in term 5.
I20251211 21:04:18.866475 2227 raft_consensus.cc:993] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower aa211fd16a6744bbaa4bbb4545567bae to start an election
I20251211 21:04:18.866608 2227 raft_consensus.cc:1081] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Signalling peer aa211fd16a6744bbaa4bbb4545567bae to start an election
I20251211 21:04:18.866972 1851 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7"
dest_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
from {username='slave'} at 127.0.0.1:46958
I20251211 21:04:18.867089 1851 raft_consensus.cc:493] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:18.867147 1851 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:18.868283 1851 raft_consensus.cc:515] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:18.868655 1851 leader_election.cc:290] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [CANDIDATE]: Term 3 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:18.868901 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "aa211fd16a6744bbaa4bbb4545567bae" candidate_term: 3 candidate_status { last_received { term: 2 index: 29 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:18.868901 1370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "aa211fd16a6744bbaa4bbb4545567bae" candidate_term: 3 candidate_status { last_received { term: 2 index: 29 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:18.869019 1445 raft_consensus.cc:3055] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Stepping down as leader of term 2
I20251211 21:04:18.869097 1445 raft_consensus.cc:740] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:18.869102 1370 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:18.869235 1445 consensus_queue.cc:260] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:18.869390 1445 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:18.870064 1370 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa211fd16a6744bbaa4bbb4545567bae in term 3.
I20251211 21:04:18.870229 1445 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa211fd16a6744bbaa4bbb4545567bae in term 3.
I20251211 21:04:18.870340 1814 leader_election.cc:304] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, aa211fd16a6744bbaa4bbb4545567bae; no voters:
I20251211 21:04:18.870497 2188 raft_consensus.cc:2804] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:04:18.870723 2188 raft_consensus.cc:697] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 3 LEADER]: Becoming Leader. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Running, Role: LEADER
I20251211 21:04:18.870863 2188 consensus_queue.cc:237] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:18.872331 1266 catalog_manager.cc:5654] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae reported cstate change: term changed from 2 to 3, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197). New cstate: current_term: 3 leader_uuid: "aa211fd16a6744bbaa4bbb4545567bae" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:18.914584 1521 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:18.915015 2208 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:18.917411 1370 raft_consensus.cc:1275] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:18.917761 2208 consensus_queue.cc:1048] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:18.926991 2251 ts_tablet_manager.cc:933] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: Initiating tablet copy from peer 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:18.927379 2251 tablet_copy_client.cc:323] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:34101
I20251211 21:04:18.927783 1457 tablet_copy_service.cc:140] P 22f0fcdd6d614884843d6ef3bca6708f: Received BeginTabletCopySession request for tablet f04c059ecaa6400781a090ca30270262 from peer 2327d27b0bd449ea89201c0404e0915f ({username='slave'} at 127.0.0.1:58120)
I20251211 21:04:18.927886 1457 tablet_copy_service.cc:161] P 22f0fcdd6d614884843d6ef3bca6708f: Beginning new tablet copy session on tablet f04c059ecaa6400781a090ca30270262 from peer 2327d27b0bd449ea89201c0404e0915f at {username='slave'} at 127.0.0.1:58120: session id = 2327d27b0bd449ea89201c0404e0915f-f04c059ecaa6400781a090ca30270262
I20251211 21:04:18.928893 1457 tablet_copy_source_session.cc:215] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:18.929644 2251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04c059ecaa6400781a090ca30270262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:18.932135 2251 tablet_copy_client.cc:806] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:18.932300 2251 tablet_copy_client.cc:670] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:18.933192 2252 tablet_copy_client.cc:1025] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:18.948086 2253 ts_tablet_manager.cc:933] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: Initiating tablet copy from peer 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:18.948477 2253 tablet_copy_client.cc:323] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.196:36747
I20251211 21:04:18.952301 1785 tablet_copy_service.cc:140] P 2327d27b0bd449ea89201c0404e0915f: Received BeginTabletCopySession request for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 from peer aa211fd16a6744bbaa4bbb4545567bae ({username='slave'} at 127.0.0.1:38820)
I20251211 21:04:18.952409 1785 tablet_copy_service.cc:161] P 2327d27b0bd449ea89201c0404e0915f: Beginning new tablet copy session on tablet 2e0e0cc37a5b41fd90c461aff17e8d28 from peer aa211fd16a6744bbaa4bbb4545567bae at {username='slave'} at 127.0.0.1:38820: session id = aa211fd16a6744bbaa4bbb4545567bae-2e0e0cc37a5b41fd90c461aff17e8d28
I20251211 21:04:18.953190 1785 tablet_copy_source_session.cc:215] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:18.954057 2253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0e0cc37a5b41fd90c461aff17e8d28. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:18.956200 2253 tablet_copy_client.cc:806] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:18.956355 2253 tablet_copy_client.cc:670] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:18.957377 2254 tablet_copy_client.cc:1025] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:18.986855 2256 ts_tablet_manager.cc:933] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: Initiating tablet copy from peer 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469)
I20251211 21:04:18.987239 2256 tablet_copy_client.cc:323] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.193:33469
I20251211 21:04:18.987586 1382 tablet_copy_service.cc:140] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Received BeginTabletCopySession request for tablet 9afcbdf999514a22badd7550b63d8cb8 from peer aa211fd16a6744bbaa4bbb4545567bae ({username='slave'} at 127.0.0.1:32976)
I20251211 21:04:18.987725 1382 tablet_copy_service.cc:161] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Beginning new tablet copy session on tablet 9afcbdf999514a22badd7550b63d8cb8 from peer aa211fd16a6744bbaa4bbb4545567bae at {username='slave'} at 127.0.0.1:32976: session id = aa211fd16a6744bbaa4bbb4545567bae-9afcbdf999514a22badd7550b63d8cb8
I20251211 21:04:18.988597 1382 tablet_copy_source_session.cc:215] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:18.989357 2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afcbdf999514a22badd7550b63d8cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:18.991505 2256 tablet_copy_client.cc:806] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:18.991676 2256 tablet_copy_client.cc:670] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:18.992923 2257 tablet_copy_client.cc:1025] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:19.063362 2258 ts_tablet_manager.cc:933] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: Initiating tablet copy from peer 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469)
I20251211 21:04:19.063724 2258 tablet_copy_client.cc:323] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.193:33469
I20251211 21:04:19.064123 1382 tablet_copy_service.cc:140] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Received BeginTabletCopySession request for tablet b5145c85694243d88e619a1c643c6909 from peer 2327d27b0bd449ea89201c0404e0915f ({username='slave'} at 127.0.0.1:32972)
I20251211 21:04:19.064216 1382 tablet_copy_service.cc:161] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Beginning new tablet copy session on tablet b5145c85694243d88e619a1c643c6909 from peer 2327d27b0bd449ea89201c0404e0915f at {username='slave'} at 127.0.0.1:32972: session id = 2327d27b0bd449ea89201c0404e0915f-b5145c85694243d88e619a1c643c6909
I20251211 21:04:19.065142 1382 tablet_copy_source_session.cc:215] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:19.065882 2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5145c85694243d88e619a1c643c6909. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:19.067834 2258 tablet_copy_client.cc:806] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:19.067989 2258 tablet_copy_client.cc:670] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:19.068953 2259 tablet_copy_client.cc:1025] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:19.087723 2260 ts_tablet_manager.cc:933] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: Initiating tablet copy from peer 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051)
I20251211 21:04:19.088065 2260 tablet_copy_client.cc:323] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:45051
I20251211 21:04:19.088461 1533 tablet_copy_service.cc:140] P 5eec57358d0f4ba48d683b4c7d445454: Received BeginTabletCopySession request for tablet 91d55fcc7df346549c84ae6cfdcf36ad from peer f5074d327f094246ad9acb355421d061 ({username='slave'} at 127.0.0.1:56302)
I20251211 21:04:19.088582 1533 tablet_copy_service.cc:161] P 5eec57358d0f4ba48d683b4c7d445454: Beginning new tablet copy session on tablet 91d55fcc7df346549c84ae6cfdcf36ad from peer f5074d327f094246ad9acb355421d061 at {username='slave'} at 127.0.0.1:56302: session id = f5074d327f094246ad9acb355421d061-91d55fcc7df346549c84ae6cfdcf36ad
I20251211 21:04:19.089293 1533 tablet_copy_source_session.cc:215] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:19.090014 2260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d55fcc7df346549c84ae6cfdcf36ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:19.092450 2260 tablet_copy_client.cc:806] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:19.092626 2260 tablet_copy_client.cc:670] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:19.093802 2261 tablet_copy_client.cc:1025] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:19.104333 2262 ts_tablet_manager.cc:933] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: Initiating tablet copy from peer 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101)
I20251211 21:04:19.104911 2262 tablet_copy_client.cc:323] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:34101
I20251211 21:04:19.105263 1457 tablet_copy_service.cc:140] P 22f0fcdd6d614884843d6ef3bca6708f: Received BeginTabletCopySession request for tablet 70e1f34692834e4cb9ffbdbbbc356141 from peer f5074d327f094246ad9acb355421d061 ({username='slave'} at 127.0.0.1:46506)
I20251211 21:04:19.105368 1457 tablet_copy_service.cc:161] P 22f0fcdd6d614884843d6ef3bca6708f: Beginning new tablet copy session on tablet 70e1f34692834e4cb9ffbdbbbc356141 from peer f5074d327f094246ad9acb355421d061 at {username='slave'} at 127.0.0.1:46506: session id = f5074d327f094246ad9acb355421d061-70e1f34692834e4cb9ffbdbbbc356141
I20251211 21:04:19.106246 1457 tablet_copy_source_session.cc:215] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:19.107040 2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e1f34692834e4cb9ffbdbbbc356141. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:19.109025 2262 tablet_copy_client.cc:806] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:19.109166 2262 tablet_copy_client.cc:670] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:19.110204 2263 tablet_copy_client.cc:1025] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: tablet copy: Injecting latency into file download: 2000
I20251211 21:04:19.207798 1521 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:19.208210 2141 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:19.210534 1926 raft_consensus.cc:1275] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251211 21:04:19.211098 2206 consensus_queue.cc:1048] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:19.396692 1521 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 5 FOLLOWER]: Refusing update from remote peer f5074d327f094246ad9acb355421d061: Log matching property violated. Preceding OpId in replica: term: 4 index: 31. Preceding OpId from leader: term: 5 index: 32. (index mismatch)
I20251211 21:04:19.397073 2241 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:19.401036 1445 raft_consensus.cc:1275] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 5 FOLLOWER]: Refusing update from remote peer f5074d327f094246ad9acb355421d061: Log matching property violated. Preceding OpId in replica: term: 4 index: 31. Preceding OpId from leader: term: 5 index: 32. (index mismatch)
I20251211 21:04:19.401374 2269 consensus_queue.cc:1048] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:19.409281 1370 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251211 21:04:19.409708 2188 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:19.412405 1445 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251211 21:04:19.414186 2273 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:20.382578 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:20.384500 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "5eec57358d0f4ba48d683b4c7d445454"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:20.384737 1371 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Received request to transfer leadership to TS 5eec57358d0f4ba48d683b4c7d445454
I20251211 21:04:20.385046 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:20.385169 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:20.676438 2267 raft_consensus.cc:993] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 5eec57358d0f4ba48d683b4c7d445454 to start an election
I20251211 21:04:20.676566 2267 raft_consensus.cc:1081] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Signalling peer 5eec57358d0f4ba48d683b4c7d445454 to start an election
I20251211 21:04:20.676955 1518 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
from {username='slave'} at 127.0.0.1:56258
I20251211 21:04:20.677078 1518 raft_consensus.cc:493] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:20.677145 1518 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:20.677966 1518 raft_consensus.cc:515] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:20.678339 1518 leader_election.cc:290] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 5 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:20.678551 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 5 candidate_status { last_received { term: 4 index: 31 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:20.678592 1774 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "5eec57358d0f4ba48d683b4c7d445454" candidate_term: 5 candidate_status { last_received { term: 4 index: 31 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:20.678712 1371 raft_consensus.cc:3055] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Stepping down as leader of term 4
I20251211 21:04:20.678715 1774 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:20.678788 1371 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:20.678953 1371 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 4.31, Last appended by leader: 31, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:20.679174 1371 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:20.679651 1774 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 5.
I20251211 21:04:20.679960 1487 leader_election.cc:304] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2327d27b0bd449ea89201c0404e0915f, 5eec57358d0f4ba48d683b4c7d445454; no voters:
I20251211 21:04:20.680176 2280 raft_consensus.cc:2804] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 FOLLOWER]: Leader election won for term 5
I20251211 21:04:20.680322 2280 raft_consensus.cc:697] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 LEADER]: Becoming Leader. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:20.680445 2280 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 4.31, Last appended by leader: 31, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:20.680591 1371 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eec57358d0f4ba48d683b4c7d445454 in term 5.
I20251211 21:04:20.682201 1266 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: term changed from 4 to 5, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195). New cstate: current_term: 5 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:20.686285 1521 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:20.686422 1521 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 LEADER]: Received request to transfer leadership
I20251211 21:04:20.691494 1521 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:20.691669 1521 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 LEADER]: Received request to transfer leadership
W20251211 21:04:20.691927 1255 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 9afcbdf999514a22badd7550b63d8cb8 already in progress [suppressed 1 similar messages]
I20251211 21:04:20.692623 1521 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:20.692755 1521 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 LEADER]: Received request to transfer leadership
W20251211 21:04:20.693059 1317 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for 9afcbdf999514a22badd7550b63d8cb8 already in progress
W20251211 21:04:20.693113 1317 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 9afcbdf999514a22badd7550b63d8cb8 already in progress
I20251211 21:04:20.933434 2251 tablet_copy_client.cc:538] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:20.934927 2251 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap starting.
I20251211 21:04:20.957657 2253 tablet_copy_client.cc:538] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:20.958748 2251 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap replayed 1/1 log segments. Stats: ops{read=31 overwritten=0 applied=31 ignored=0} inserts{seen=114 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:20.959002 2251 tablet_bootstrap.cc:492] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap complete.
I20251211 21:04:20.959057 2253 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap starting.
I20251211 21:04:20.959185 2251 ts_tablet_manager.cc:1403] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: Time spent bootstrapping tablet: real 0.024s user 0.020s sys 0.002s
I20251211 21:04:20.959671 2251 raft_consensus.cc:359] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:20.959815 2251 raft_consensus.cc:740] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Initialized, Role: LEARNER
I20251211 21:04:20.959923 2251 consensus_queue.cc:260] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 31, Last appended: 3.31, Last appended by leader: 31, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:20.960287 2251 ts_tablet_manager.cc:1434] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20251211 21:04:20.961515 1457 tablet_copy_service.cc:342] P 22f0fcdd6d614884843d6ef3bca6708f: Request end of tablet copy session 2327d27b0bd449ea89201c0404e0915f-f04c059ecaa6400781a090ca30270262 received from {username='slave'} at 127.0.0.1:58120
I20251211 21:04:20.961596 1457 tablet_copy_service.cc:434] P 22f0fcdd6d614884843d6ef3bca6708f: ending tablet copy session 2327d27b0bd449ea89201c0404e0915f-f04c059ecaa6400781a090ca30270262 on tablet f04c059ecaa6400781a090ca30270262 with peer 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:20.981822 2253 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=30 overwritten=0 applied=30 ignored=0} inserts{seen=101 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:20.982203 2253 tablet_bootstrap.cc:492] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap complete.
I20251211 21:04:20.982432 2253 ts_tablet_manager.cc:1403] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.008s
I20251211 21:04:20.982875 2253 raft_consensus.cc:359] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:20.982982 2253 raft_consensus.cc:740] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Initialized, Role: LEARNER
I20251211 21:04:20.983067 2253 consensus_queue.cc:260] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 30, Last appended: 2.30, Last appended by leader: 30, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:20.983284 2253 ts_tablet_manager.cc:1434] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:20.983810 1785 tablet_copy_service.cc:342] P 2327d27b0bd449ea89201c0404e0915f: Request end of tablet copy session aa211fd16a6744bbaa4bbb4545567bae-2e0e0cc37a5b41fd90c461aff17e8d28 received from {username='slave'} at 127.0.0.1:38820
I20251211 21:04:20.983916 1785 tablet_copy_service.cc:434] P 2327d27b0bd449ea89201c0404e0915f: ending tablet copy session aa211fd16a6744bbaa4bbb4545567bae-2e0e0cc37a5b41fd90c461aff17e8d28 on tablet 2e0e0cc37a5b41fd90c461aff17e8d28 with peer aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:20.993198 2256 tablet_copy_client.cc:538] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:20.994776 2256 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap starting.
I20251211 21:04:21.017375 2256 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=31 overwritten=0 applied=31 ignored=0} inserts{seen=107 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:21.017726 2256 tablet_bootstrap.cc:492] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: Bootstrap complete.
I20251211 21:04:21.017959 2256 ts_tablet_manager.cc:1403] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: Time spent bootstrapping tablet: real 0.023s user 0.019s sys 0.005s
I20251211 21:04:21.018424 2256 raft_consensus.cc:359] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:21.018551 2256 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Initialized, Role: LEARNER
I20251211 21:04:21.018656 2256 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 31, Last appended: 4.31, Last appended by leader: 31, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:21.019012 2256 ts_tablet_manager.cc:1434] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:21.020035 1382 tablet_copy_service.cc:342] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Request end of tablet copy session aa211fd16a6744bbaa4bbb4545567bae-9afcbdf999514a22badd7550b63d8cb8 received from {username='slave'} at 127.0.0.1:32976
I20251211 21:04:21.020113 1382 tablet_copy_service.cc:434] P 2d3e56eb6a174c3eb932f4bcdc62e18c: ending tablet copy session aa211fd16a6744bbaa4bbb4545567bae-9afcbdf999514a22badd7550b63d8cb8 on tablet 9afcbdf999514a22badd7550b63d8cb8 with peer aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:21.069214 2258 tablet_copy_client.cc:538] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:21.070868 2258 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap starting.
I20251211 21:04:21.091049 2258 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=93 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:21.091327 2258 tablet_bootstrap.cc:492] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: Bootstrap complete.
I20251211 21:04:21.091516 2258 ts_tablet_manager.cc:1403] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.002s
I20251211 21:04:21.092008 2258 raft_consensus.cc:359] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:21.092123 2258 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Initialized, Role: LEARNER
I20251211 21:04:21.092216 2258 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 2.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: true } }
I20251211 21:04:21.092540 2258 ts_tablet_manager.cc:1434] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20251211 21:04:21.092998 1382 tablet_copy_service.cc:342] P 2d3e56eb6a174c3eb932f4bcdc62e18c: Request end of tablet copy session 2327d27b0bd449ea89201c0404e0915f-b5145c85694243d88e619a1c643c6909 received from {username='slave'} at 127.0.0.1:32972
I20251211 21:04:21.093079 1382 tablet_copy_service.cc:434] P 2d3e56eb6a174c3eb932f4bcdc62e18c: ending tablet copy session 2327d27b0bd449ea89201c0404e0915f-b5145c85694243d88e619a1c643c6909 on tablet b5145c85694243d88e619a1c643c6909 with peer 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:21.094058 2260 tablet_copy_client.cc:538] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:21.095530 2260 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: Bootstrap starting.
I20251211 21:04:21.110503 2262 tablet_copy_client.cc:538] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:21.111719 2262 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: Bootstrap starting.
I20251211 21:04:21.116756 2260 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: Bootstrap replayed 1/1 log segments. Stats: ops{read=31 overwritten=0 applied=31 ignored=0} inserts{seen=105 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:21.117046 2260 tablet_bootstrap.cc:492] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: Bootstrap complete.
I20251211 21:04:21.117225 2260 ts_tablet_manager.cc:1403] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: Time spent bootstrapping tablet: real 0.022s user 0.018s sys 0.003s
I20251211 21:04:21.117755 2260 raft_consensus.cc:359] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:21.117998 2260 raft_consensus.cc:740] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f5074d327f094246ad9acb355421d061, State: Initialized, Role: LEARNER
I20251211 21:04:21.118151 2260 consensus_queue.cc:260] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 31, Last appended: 3.31, Last appended by leader: 31, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:21.118898 2260 ts_tablet_manager.cc:1434] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:04:21.119736 1533 tablet_copy_service.cc:342] P 5eec57358d0f4ba48d683b4c7d445454: Request end of tablet copy session f5074d327f094246ad9acb355421d061-91d55fcc7df346549c84ae6cfdcf36ad received from {username='slave'} at 127.0.0.1:56302
I20251211 21:04:21.119825 1533 tablet_copy_service.cc:434] P 5eec57358d0f4ba48d683b4c7d445454: ending tablet copy session f5074d327f094246ad9acb355421d061-91d55fcc7df346549c84ae6cfdcf36ad on tablet 91d55fcc7df346549c84ae6cfdcf36ad with peer f5074d327f094246ad9acb355421d061
I20251211 21:04:21.132731 2262 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: Bootstrap replayed 1/1 log segments. Stats: ops{read=29 overwritten=0 applied=29 ignored=0} inserts{seen=101 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:21.133018 2262 tablet_bootstrap.cc:492] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: Bootstrap complete.
I20251211 21:04:21.133191 2262 ts_tablet_manager.cc:1403] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: Time spent bootstrapping tablet: real 0.022s user 0.019s sys 0.000s
I20251211 21:04:21.133852 2262 raft_consensus.cc:359] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:21.133965 2262 raft_consensus.cc:740] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5074d327f094246ad9acb355421d061, State: Initialized, Role: LEARNER
I20251211 21:04:21.134058 2262 consensus_queue.cc:260] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 29, Last appended: 1.29, Last appended by leader: 29, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: NON_VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: true } }
I20251211 21:04:21.134341 2262 ts_tablet_manager.cc:1434] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:21.134824 1457 tablet_copy_service.cc:342] P 22f0fcdd6d614884843d6ef3bca6708f: Request end of tablet copy session f5074d327f094246ad9acb355421d061-70e1f34692834e4cb9ffbdbbbc356141 received from {username='slave'} at 127.0.0.1:46506
I20251211 21:04:21.134910 1457 tablet_copy_service.cc:434] P 22f0fcdd6d614884843d6ef3bca6708f: ending tablet copy session f5074d327f094246ad9acb355421d061-70e1f34692834e4cb9ffbdbbbc356141 on tablet 70e1f34692834e4cb9ffbdbbbc356141 with peer f5074d327f094246ad9acb355421d061
I20251211 21:04:21.150919 1851 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 4 LEARNER]: Advancing to term 5
I20251211 21:04:21.152081 1851 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 5 LEARNER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 4 index: 31. Preceding OpId from leader: term: 5 index: 32. (index mismatch)
I20251211 21:04:21.152925 2288 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:21.155241 2280 raft_consensus.cc:1064] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
W20251211 21:04:21.155313 2280 raft_consensus.cc:1067] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Unable to promote non-voter aa211fd16a6744bbaa4bbb4545567bae: Service unavailable: leader transfer in progress
I20251211 21:04:21.178040 1926 raft_consensus.cc:1217] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.28->[1.29-1.29] Dedup: 1.29->[]
I20251211 21:04:21.182315 1370 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 5 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 4 index: 31. Preceding OpId from leader: term: 5 index: 32. (index mismatch)
I20251211 21:04:21.182683 2280 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:21.184180 2288 raft_consensus.cc:993] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:21.184307 2280 raft_consensus.cc:1081] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:21.185091 1370 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40790
I20251211 21:04:21.185230 1370 raft_consensus.cc:493] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:21.185283 1370 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 5 FOLLOWER]: Advancing to term 6
I20251211 21:04:21.185799 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 5 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 4 index: 31. Preceding OpId from leader: term: 5 index: 32. (index mismatch)
I20251211 21:04:21.186193 2280 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:21.186405 1370 raft_consensus.cc:515] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:21.186476 2288 raft_consensus.cc:1064] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
W20251211 21:04:21.186560 2288 raft_consensus.cc:1067] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Unable to promote non-voter aa211fd16a6744bbaa4bbb4545567bae: Service unavailable: leader transfer in progress
I20251211 21:04:21.186784 1370 leader_election.cc:290] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 6 election: Requested vote from peers 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:21.187755 1518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 32 } } ignore_live_leader: true dest_uuid: "5eec57358d0f4ba48d683b4c7d445454"
I20251211 21:04:21.187848 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 32 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:21.187855 1518 raft_consensus.cc:3055] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 LEADER]: Stepping down as leader of term 5
I20251211 21:04:21.189107 1518 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5eec57358d0f4ba48d683b4c7d445454, State: Running, Role: LEADER
I20251211 21:04:21.189234 1518 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 5.32, Last appended by leader: 32, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:21.189388 1518 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 5 FOLLOWER]: Advancing to term 6
I20251211 21:04:21.190227 1518 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 6.
I20251211 21:04:21.190475 1337 leader_election.cc:304] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3e56eb6a174c3eb932f4bcdc62e18c, 5eec57358d0f4ba48d683b4c7d445454; no voters: 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:21.190616 2267 raft_consensus.cc:2804] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 FOLLOWER]: Leader election won for term 6
I20251211 21:04:21.190815 2267 raft_consensus.cc:697] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:21.190958 2267 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 5.32, Last appended by leader: 32, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } }
I20251211 21:04:21.192448 1260 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 5 to 6, leader changed from 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 6 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:21.305382 1775 raft_consensus.cc:1217] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.30->[3.31-3.31] Dedup: 3.31->[]
I20251211 21:04:21.429607 1851 raft_consensus.cc:1217] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEARNER]: Deduplicated request from leader. Original: 2.29->[2.30-2.30] Dedup: 2.30->[]
I20251211 21:04:21.514983 1926 raft_consensus.cc:1217] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.30->[3.31-3.31] Dedup: 3.31->[]
I20251211 21:04:21.580924 2316 raft_consensus.cc:1064] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER f5074d327f094246ad9acb355421d061 to VOTER
I20251211 21:04:21.581379 2316 consensus_queue.cc:237] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:21.582628 1926 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251211 21:04:21.582686 1851 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251211 21:04:21.582916 1370 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251211 21:04:21.582975 2316 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:21.583139 2315 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:21.583312 2277 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:21.585762 2277 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:21.586136 1926 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:21.587474 1518 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 6 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 32. Preceding OpId from leader: term: 6 index: 33. (index mismatch)
I20251211 21:04:21.587563 1851 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:21.587991 2267 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:21.588601 1260 catalog_manager.cc:5654] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: config changed from index 29 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:21.590747 1851 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 5 LEARNER]: Advancing to term 6
I20251211 21:04:21.590764 1774 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 5 FOLLOWER]: Advancing to term 6
I20251211 21:04:21.591059 1370 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:21.591684 1851 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 6 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 32. Preceding OpId from leader: term: 6 index: 33. (index mismatch)
I20251211 21:04:21.591684 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 32. Preceding OpId from leader: term: 6 index: 33. (index mismatch)
I20251211 21:04:21.592299 2311 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: NON_VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:21.592320 1774 raft_consensus.cc:1217] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.25->[2.26-2.26] Dedup: 2.26->[]
I20251211 21:04:21.593567 2267 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:21.595170 2311 raft_consensus.cc:1064] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
I20251211 21:04:21.595539 2311 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 6.33, Last appended by leader: 32, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:21.596890 1443 consensus_queue.cc:237] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:21.596995 1518 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 6 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 33. Preceding OpId from leader: term: 6 index: 34. (index mismatch)
I20251211 21:04:21.597294 2311 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251211 21:04:21.597939 1926 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20251211 21:04:21.598237 2316 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:21.598636 1850 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 6 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 33. Preceding OpId from leader: term: 6 index: 34. (index mismatch)
I20251211 21:04:21.598716 1851 raft_consensus.cc:1275] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20251211 21:04:21.599290 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 33. Preceding OpId from leader: term: 6 index: 34. (index mismatch)
I20251211 21:04:21.599500 2315 consensus_queue.cc:1048] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:21.599912 2325 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251211 21:04:21.600107 2322 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251211 21:04:21.601368 2318 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:21.601773 1851 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:21.602002 2311 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Committing config change with OpId 6.34: config changed from index 31 to 34, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.603020 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 70e1f34692834e4cb9ffbdbbbc356141 with cas_config_opid_index 30: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:21.601773 1926 raft_consensus.cc:2955] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:21.603412 1851 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 6 FOLLOWER]: Committing config change with OpId 6.34: config changed from index 31 to 34, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.604321 1266 catalog_manager.cc:5654] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae reported cstate change: config changed from index 30 to 31, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:21.606293 1518 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 6 FOLLOWER]: Committing config change with OpId 6.34: config changed from index 31 to 34, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.606935 1262 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 31 to 34, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:21.608058 1357 tablet_service.cc:1552] Processing DeleteTablet for tablet 70e1f34692834e4cb9ffbdbbbc356141 with delete_type TABLET_DATA_TOMBSTONED (TS 2d3e56eb6a174c3eb932f4bcdc62e18c not found in new config with opid_index 31) from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:21.608901 1774 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Committing config change with OpId 6.34: config changed from index 31 to 34, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.611080 2326 tablet_replica.cc:333] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:21.611274 2326 raft_consensus.cc:2243] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:21.611483 2326 raft_consensus.cc:2272] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:21.612834 1370 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 6.34, Last appended by leader: 32, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:21.613771 2326 ts_tablet_manager.cc:1916] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:21.614055 1851 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 6 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 34. Preceding OpId from leader: term: 6 index: 35. (index mismatch)
I20251211 21:04:21.614087 1774 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 34. Preceding OpId from leader: term: 6 index: 35. (index mismatch)
I20251211 21:04:21.614392 2325 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251211 21:04:21.614549 2322 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251211 21:04:21.616129 2311 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Committing config change with OpId 6.35: config changed from index 34 to 35, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.616582 1775 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Committing config change with OpId 6.35: config changed from index 34 to 35, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.618073 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 9afcbdf999514a22badd7550b63d8cb8 with cas_config_opid_index 34: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:21.618152 1851 raft_consensus.cc:2955] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 6 FOLLOWER]: Committing config change with OpId 6.35: config changed from index 34 to 35, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.618290 1262 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 34 to 35, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New cstate: current_term: 6 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:21.619531 2326 ts_tablet_manager.cc:1929] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.30
I20251211 21:04:21.619659 2326 log.cc:1199] T 70e1f34692834e4cb9ffbdbbbc356141 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/70e1f34692834e4cb9ffbdbbbc356141
I20251211 21:04:21.620692 1509 tablet_service.cc:1552] Processing DeleteTablet for tablet 9afcbdf999514a22badd7550b63d8cb8 with delete_type TABLET_DATA_TOMBSTONED (TS 5eec57358d0f4ba48d683b4c7d445454 not found in new config with opid_index 35) from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:21.621748 2327 tablet_replica.cc:333] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:21.621824 1253 catalog_manager.cc:4985] TS 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469): tablet 70e1f34692834e4cb9ffbdbbbc356141 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:21.621901 2327 raft_consensus.cc:2243] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 6 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:21.622066 2327 raft_consensus.cc:2272] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454 [term 6 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:21.622678 2327 ts_tablet_manager.cc:1916] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:21.625005 2327 ts_tablet_manager.cc:1929] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.34
I20251211 21:04:21.625090 2327 log.cc:1199] T 9afcbdf999514a22badd7550b63d8cb8 P 5eec57358d0f4ba48d683b4c7d445454: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/9afcbdf999514a22badd7550b63d8cb8
I20251211 21:04:21.625600 1255 catalog_manager.cc:4985] TS 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051): tablet 9afcbdf999514a22badd7550b63d8cb8 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:21.868093 2277 raft_consensus.cc:1064] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: attempting to promote NON_VOTER 2327d27b0bd449ea89201c0404e0915f to VOTER
I20251211 21:04:21.868554 2277 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 3.31, Last appended by leader: 29, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:21.869844 1370 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251211 21:04:21.869844 1775 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 3 LEARNER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251211 21:04:21.869925 1851 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251211 21:04:21.870232 2315 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:21.870422 2316 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:21.870595 2318 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:21.872502 2315 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Committing config change with OpId 3.32: config changed from index 31 to 32, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.872853 1851 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Committing config change with OpId 3.32: config changed from index 31 to 32, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.873234 1775 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Committing config change with OpId 3.32: config changed from index 31 to 32, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.874611 1370 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Committing config change with OpId 3.32: config changed from index 31 to 32, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.874738 1261 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae reported cstate change: config changed from index 31 to 32, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } attrs { replace: true } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.878484 1445 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 3.32, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:21.879670 1774 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251211 21:04:21.879774 1851 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251211 21:04:21.879987 2277 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:21.880131 2318 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:21.881546 2316 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Committing config change with OpId 3.33: config changed from index 32 to 33, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.881906 1774 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Committing config change with OpId 3.33: config changed from index 32 to 33, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.881986 1851 raft_consensus.cc:2955] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Committing config change with OpId 3.33: config changed from index 32 to 33, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.883234 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet f04c059ecaa6400781a090ca30270262 with cas_config_opid_index 32: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:21.883925 1262 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae reported cstate change: config changed from index 32 to 33, VOTER 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) evicted. New cstate: current_term: 3 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:21.886128 1357 tablet_service.cc:1552] Processing DeleteTablet for tablet f04c059ecaa6400781a090ca30270262 with delete_type TABLET_DATA_TOMBSTONED (TS 2d3e56eb6a174c3eb932f4bcdc62e18c not found in new config with opid_index 33) from {username='slave'} at 127.0.0.1:40768
I20251211 21:04:21.886363 2326 tablet_replica.cc:333] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:21.886484 2326 raft_consensus.cc:2243] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:21.886597 2326 raft_consensus.cc:2272] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:21.887257 2326 ts_tablet_manager.cc:1916] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:21.889356 2326 ts_tablet_manager.cc:1929] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.32
I20251211 21:04:21.889437 2326 log.cc:1199] T f04c059ecaa6400781a090ca30270262 P 2d3e56eb6a174c3eb932f4bcdc62e18c: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/f04c059ecaa6400781a090ca30270262
I20251211 21:04:21.889900 1253 catalog_manager.cc:4985] TS 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469): tablet f04c059ecaa6400781a090ca30270262 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:21.909320 2332 raft_consensus.cc:1064] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: attempting to promote NON_VOTER aa211fd16a6744bbaa4bbb4545567bae to VOTER
I20251211 21:04:21.909719 2332 consensus_queue.cc:237] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 2.30, Last appended by leader: 28, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:21.911098 1445 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251211 21:04:21.911168 1851 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEARNER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251211 21:04:21.911413 1521 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251211 21:04:21.911474 2334 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:21.911791 2324 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:21.911967 2332 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:21.913741 2324 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEADER]: Committing config change with OpId 2.31: config changed from index 30 to 31, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.914129 1445 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.914462 1521 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.915438 1851 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.916466 1263 catalog_manager.cc:5654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 30 to 31, aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2327d27b0bd449ea89201c0404e0915f" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.920082 1774 consensus_queue.cc:237] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:21.921046 1851 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251211 21:04:21.921069 1521 raft_consensus.cc:1275] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251211 21:04:21.921365 2332 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:21.921550 2334 consensus_queue.cc:1048] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:21.922884 2324 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEADER]: Committing config change with OpId 2.32: config changed from index 31 to 32, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.923233 1521 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Committing config change with OpId 2.32: config changed from index 31 to 32, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.923996 1851 raft_consensus.cc:2955] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Committing config change with OpId 2.32: config changed from index 31 to 32, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.924775 1313 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 with cas_config_opid_index 31: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:21.925248 1262 catalog_manager.cc:5654] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 reported cstate change: config changed from index 31 to 32, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New cstate: current_term: 2 leader_uuid: "2327d27b0bd449ea89201c0404e0915f" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } }
I20251211 21:04:21.927560 1433 tablet_service.cc:1552] Processing DeleteTablet for tablet 2e0e0cc37a5b41fd90c461aff17e8d28 with delete_type TABLET_DATA_TOMBSTONED (TS 22f0fcdd6d614884843d6ef3bca6708f not found in new config with opid_index 32) from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:21.928036 2338 tablet_replica.cc:333] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:21.928202 2338 raft_consensus.cc:2243] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:21.928349 2338 raft_consensus.cc:2272] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:21.928895 2338 ts_tablet_manager.cc:1916] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:21.931010 2338 ts_tablet_manager.cc:1929] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.31
I20251211 21:04:21.931088 2338 log.cc:1199] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 22f0fcdd6d614884843d6ef3bca6708f: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/2e0e0cc37a5b41fd90c461aff17e8d28
I20251211 21:04:21.931530 1253 catalog_manager.cc:4985] TS 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101): tablet 2e0e0cc37a5b41fd90c461aff17e8d28 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:22.001206 2305 raft_consensus.cc:1064] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: attempting to promote NON_VOTER f5074d327f094246ad9acb355421d061 to VOTER
I20251211 21:04:22.001672 2305 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 3.31, Last appended by leader: 29, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:22.003232 1926 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 LEARNER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 3 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251211 21:04:22.003302 1445 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 3 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251211 21:04:22.003499 1775 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 3 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251211 21:04:22.003659 2342 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:22.003875 2343 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:22.004542 2343 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:22.006228 2342 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Committing config change with OpId 3.32: config changed from index 31 to 32, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.006698 1926 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 FOLLOWER]: Committing config change with OpId 3.32: config changed from index 31 to 32, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.008040 1775 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Committing config change with OpId 3.32: config changed from index 31 to 32, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.009259 1266 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 reported cstate change: config changed from index 31 to 32, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.012600 1521 consensus_queue.cc:237] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 3.32, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } }
I20251211 21:04:22.013621 1445 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Committing config change with OpId 3.32: config changed from index 31 to 32, f5074d327f094246ad9acb355421d061 (127.29.190.198) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } attrs { replace: true } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.015578 1775 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251211 21:04:22.015578 1926 raft_consensus.cc:1275] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 FOLLOWER]: Refusing update from remote peer 5eec57358d0f4ba48d683b4c7d445454: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251211 21:04:22.015982 2342 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:22.016134 2343 consensus_queue.cc:1048] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:22.017566 2343 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Committing config change with OpId 3.33: config changed from index 32 to 33, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.018349 1926 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 FOLLOWER]: Committing config change with OpId 3.33: config changed from index 32 to 33, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.018476 1775 raft_consensus.cc:2955] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Committing config change with OpId 3.33: config changed from index 32 to 33, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.020071 1255 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 91d55fcc7df346549c84ae6cfdcf36ad with cas_config_opid_index 32: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:22.020475 1261 catalog_manager.cc:5654] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f reported cstate change: config changed from index 32 to 33, VOTER 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) evicted. New cstate: current_term: 3 leader_uuid: "5eec57358d0f4ba48d683b4c7d445454" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "f5074d327f094246ad9acb355421d061" member_type: VOTER last_known_addr { host: "127.29.190.198" port: 40183 } attrs { promote: false } } }
I20251211 21:04:22.022691 1433 tablet_service.cc:1552] Processing DeleteTablet for tablet 91d55fcc7df346549c84ae6cfdcf36ad with delete_type TABLET_DATA_TOMBSTONED (TS 22f0fcdd6d614884843d6ef3bca6708f not found in new config with opid_index 33) from {username='slave'} at 127.0.0.1:58072
I20251211 21:04:22.022902 2338 tablet_replica.cc:333] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:22.023032 2338 raft_consensus.cc:2243] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:22.023151 2338 raft_consensus.cc:2272] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:22.023911 2338 ts_tablet_manager.cc:1916] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:22.026244 2338 ts_tablet_manager.cc:1929] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.32
I20251211 21:04:22.026314 2338 log.cc:1199] T 91d55fcc7df346549c84ae6cfdcf36ad P 22f0fcdd6d614884843d6ef3bca6708f: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/91d55fcc7df346549c84ae6cfdcf36ad
I20251211 21:04:22.026787 1253 catalog_manager.cc:4985] TS 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101): tablet 91d55fcc7df346549c84ae6cfdcf36ad (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:22.076836 2311 raft_consensus.cc:1064] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: attempting to promote NON_VOTER 2327d27b0bd449ea89201c0404e0915f to VOTER
I20251211 21:04:22.077301 2311 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 2.26, Last appended by leader: 24, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:22.078603 1518 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:22.079022 1445 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:22.079133 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEARNER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251211 21:04:22.079311 2325 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:22.079483 2267 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:22.079653 2322 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251211 21:04:22.081862 2311 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Committing config change with OpId 2.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:22.082239 1775 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Committing config change with OpId 2.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:22.083693 1518 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Committing config change with OpId 2.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:22.085417 1266 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f reported cstate change: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:22.086380 1445 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.27: config changed from index 26 to 27, 2327d27b0bd449ea89201c0404e0915f (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "5eec57358d0f4ba48d683b4c7d445454" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 45051 } attrs { replace: true } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:22.091567 1371 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 24, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:22.092834 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:22.093184 1445 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251211 21:04:22.093355 2267 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:22.093777 2267 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251211 21:04:22.095192 2325 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Committing config change with OpId 2.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:22.096026 1775 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:22.096619 1253 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet b5145c85694243d88e619a1c643c6909 with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:22.097700 1445 raft_consensus.cc:2955] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Committing config change with OpId 2.28: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } }
I20251211 21:04:22.098096 1262 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: config changed from index 27 to 28, VOTER 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195) evicted. New cstate: current_term: 2 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:22.101362 1509 tablet_service.cc:1552] Processing DeleteTablet for tablet b5145c85694243d88e619a1c643c6909 with delete_type TABLET_DATA_TOMBSTONED (TS 5eec57358d0f4ba48d683b4c7d445454 not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:56254
I20251211 21:04:22.101548 2327 tablet_replica.cc:333] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:22.101678 2327 raft_consensus.cc:2243] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:22.101792 2327 raft_consensus.cc:2272] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:22.102363 2327 ts_tablet_manager.cc:1916] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:22.104090 2327 ts_tablet_manager.cc:1929] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.27
I20251211 21:04:22.104157 2327 log.cc:1199] T b5145c85694243d88e619a1c643c6909 P 5eec57358d0f4ba48d683b4c7d445454: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/b5145c85694243d88e619a1c643c6909
I20251211 21:04:22.104595 1255 catalog_manager.cc:4985] TS 5eec57358d0f4ba48d683b4c7d445454 (127.29.190.195:45051): tablet b5145c85694243d88e619a1c643c6909 (table test-workload [id=6a24d21be467491bbf840c8009ffc828]) successfully deleted
I20251211 21:04:22.385427 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:22.387079 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:22.387233 1371 raft_consensus.cc:606] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:22.387550 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:22.387724 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:22.482259 2267 raft_consensus.cc:993] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:22.482364 2267 raft_consensus.cc:1081] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:22.482779 1445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:22.482918 1445 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:22.482980 1445 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:22.483858 1445 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:22.484205 1445 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 3 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:22.484503 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 3 candidate_status { last_received { term: 2 index: 28 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:22.484536 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 3 candidate_status { last_received { term: 2 index: 28 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:22.484622 1775 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:22.484679 1371 raft_consensus.cc:3055] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Stepping down as leader of term 2
I20251211 21:04:22.484732 1371 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:22.484861 1371 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 2.28, Last appended by leader: 28, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:22.485013 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:04:22.485539 1775 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 3.
I20251211 21:04:22.485810 1371 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 3.
I20251211 21:04:22.485869 1412 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2327d27b0bd449ea89201c0404e0915f; no voters:
I20251211 21:04:22.486042 2315 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:04:22.486195 2315 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:22.486315 2315 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 2.28, Last appended by leader: 28, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:22.487630 1263 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 2 to 3, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 3 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:22.972349 1371 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 3 index: 29. (index mismatch)
I20251211 21:04:22.972783 2315 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:22.974936 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 3 index: 29. (index mismatch)
I20251211 21:04:22.975323 2353 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251211 21:04:24.388062 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:24.389858 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:24.390014 1445 raft_consensus.cc:606] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:24.390384 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:24.390504 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:24.687075 2357 raft_consensus.cc:993] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:24.687178 2357 raft_consensus.cc:1081] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:24.687547 1371 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40782
I20251211 21:04:24.687709 1371 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:24.687775 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:24.688611 1371 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:24.689018 1371 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 4 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:24.689316 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 29 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:24.689380 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 29 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:24.689424 1445 raft_consensus.cc:3055] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Stepping down as leader of term 3
I20251211 21:04:24.689473 1445 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:24.689484 1775 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:24.689615 1445 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 3.29, Last appended by leader: 29, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:24.689760 1445 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:24.690282 1775 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 4.
I20251211 21:04:24.690553 1336 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2327d27b0bd449ea89201c0404e0915f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:24.690567 1445 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 4.
I20251211 21:04:24.690740 2267 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Leader election won for term 4
I20251211 21:04:24.690894 2267 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:24.691025 2267 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 3.29, Last appended by leader: 29, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:24.692407 1261 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 3 to 4, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 4 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:25.255087 1445 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 29. Preceding OpId from leader: term: 4 index: 30. (index mismatch)
I20251211 21:04:25.255517 2267 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:25.258468 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 29. Preceding OpId from leader: term: 4 index: 30. (index mismatch)
I20251211 21:04:25.258822 2366 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251211 21:04:26.390830 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:26.392622 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:26.392772 1371 raft_consensus.cc:606] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:26.393157 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:26.393272 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:26.691350 2373 raft_consensus.cc:993] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:26.691457 2373 raft_consensus.cc:1081] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:26.691907 1445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:26.692044 1445 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:26.692101 1445 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:26.692936 1445 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:26.693354 1445 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 5 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:26.693684 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 5 candidate_status { last_received { term: 4 index: 30 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:26.693729 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 5 candidate_status { last_received { term: 4 index: 30 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:26.693828 1775 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:26.693835 1371 raft_consensus.cc:3055] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Stepping down as leader of term 4
I20251211 21:04:26.693907 1371 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:26.694046 1371 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 4.30, Last appended by leader: 30, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:26.694187 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Advancing to term 5
I20251211 21:04:26.694741 1775 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 5.
I20251211 21:04:26.694908 1371 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 5.
I20251211 21:04:26.695062 1412 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2327d27b0bd449ea89201c0404e0915f; no voters:
I20251211 21:04:26.695261 2357 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 5 FOLLOWER]: Leader election won for term 5
I20251211 21:04:26.695400 2357 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 5 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:26.695523 2357 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 4.30, Last appended by leader: 30, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:26.696864 1263 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 4 to 5, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 5 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:27.252295 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 5 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 4 index: 30. Preceding OpId from leader: term: 5 index: 31. (index mismatch)
I20251211 21:04:27.252790 2357 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:27.255448 1371 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 5 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 4 index: 30. Preceding OpId from leader: term: 5 index: 31. (index mismatch)
I20251211 21:04:27.255836 2357 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:28.393582 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:28.395188 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:28.395347 1445 raft_consensus.cc:606] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 5 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:28.395709 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:28.395814 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:28.635592 2357 raft_consensus.cc:993] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:28.635753 2357 raft_consensus.cc:1081] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 5 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:28.636171 1371 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40782
I20251211 21:04:28.636300 1371 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:28.636364 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 5 FOLLOWER]: Advancing to term 6
I20251211 21:04:28.637192 1371 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:28.637521 1371 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 6 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:28.637810 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 31 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:28.637907 1445 raft_consensus.cc:3055] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 5 LEADER]: Stepping down as leader of term 5
I20251211 21:04:28.637863 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 31 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:28.637956 1445 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:28.638017 1775 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 5 FOLLOWER]: Advancing to term 6
I20251211 21:04:28.638098 1445 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 5.31, Last appended by leader: 31, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:28.638267 1445 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 5 FOLLOWER]: Advancing to term 6
I20251211 21:04:28.638844 1775 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 6.
I20251211 21:04:28.638998 1445 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 6.
I20251211 21:04:28.639171 1336 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2327d27b0bd449ea89201c0404e0915f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:28.639333 2373 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 FOLLOWER]: Leader election won for term 6
I20251211 21:04:28.639483 2373 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:28.639597 2373 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 5.31, Last appended by leader: 31, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:28.641042 1261 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 5 to 6, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 6 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:29.044020 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 31. Preceding OpId from leader: term: 6 index: 32. (index mismatch)
I20251211 21:04:29.044461 2373 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:29.047320 1445 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 6 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 31. Preceding OpId from leader: term: 6 index: 32. (index mismatch)
I20251211 21:04:29.047711 2373 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251211 21:04:30.396104 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:30.398010 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:30.398167 1371 raft_consensus.cc:606] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:30.398521 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:30.398643 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:30.588944 2400 raft_consensus.cc:993] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:30.589056 2400 raft_consensus.cc:1081] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:30.589480 1445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:30.589630 1445 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:30.589700 1445 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 6 FOLLOWER]: Advancing to term 7
I20251211 21:04:30.590559 1445 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:30.590914 1445 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 7 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:30.591180 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 7 candidate_status { last_received { term: 6 index: 32 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:30.591291 1371 raft_consensus.cc:3055] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Stepping down as leader of term 6
I20251211 21:04:30.591321 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 7 candidate_status { last_received { term: 6 index: 32 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:30.591336 1371 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:30.591470 1775 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Advancing to term 7
I20251211 21:04:30.591572 1371 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 6.32, Last appended by leader: 32, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:30.591758 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 FOLLOWER]: Advancing to term 7
I20251211 21:04:30.592278 1775 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 7.
I20251211 21:04:30.592460 1371 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 7.
I20251211 21:04:30.592582 1412 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2327d27b0bd449ea89201c0404e0915f; no voters:
I20251211 21:04:30.592756 2357 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 7 FOLLOWER]: Leader election won for term 7
I20251211 21:04:30.592912 2357 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 7 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:30.593199 2357 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 6.32, Last appended by leader: 32, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:30.594511 1263 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 6 to 7, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 7 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:31.154412 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 7 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 6 index: 32. Preceding OpId from leader: term: 7 index: 33. (index mismatch)
I20251211 21:04:31.154824 2357 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:31.155872 1371 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 7 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 6 index: 32. Preceding OpId from leader: term: 7 index: 33. (index mismatch)
I20251211 21:04:31.156231 2357 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251211 21:04:32.398964 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:32.400837 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:32.400991 1445 raft_consensus.cc:606] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 7 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:32.401317 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:32.401432 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:32.691687 2410 raft_consensus.cc:993] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:32.691808 2410 raft_consensus.cc:1081] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 7 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:32.692269 1371 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:40782
I20251211 21:04:32.692421 1371 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:32.692474 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 7 FOLLOWER]: Advancing to term 8
I20251211 21:04:32.693291 1371 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:32.693698 1371 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 8 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:32.693987 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 33 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:32.694092 1445 raft_consensus.cc:3055] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 7 LEADER]: Stepping down as leader of term 7
I20251211 21:04:32.694135 1445 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:32.694104 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 33 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:32.694242 1775 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 7 FOLLOWER]: Advancing to term 8
I20251211 21:04:32.694283 1445 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 7.33, Last appended by leader: 33, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:32.694438 1445 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 7 FOLLOWER]: Advancing to term 8
I20251211 21:04:32.695103 1775 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 8.
I20251211 21:04:32.695169 1445 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 8.
I20251211 21:04:32.695403 1336 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2327d27b0bd449ea89201c0404e0915f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:32.695631 2400 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 8 FOLLOWER]: Leader election won for term 8
I20251211 21:04:32.695803 2400 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 8 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:32.695950 2400 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 7.33, Last appended by leader: 33, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:32.697458 1261 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 7 to 8, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 8 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:33.225339 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 8 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 33. Preceding OpId from leader: term: 8 index: 34. (index mismatch)
I20251211 21:04:33.225811 2400 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251211 21:04:33.228564 1445 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 8 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 33. Preceding OpId from leader: term: 8 index: 34. (index mismatch)
I20251211 21:04:33.229152 2427 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251211 21:04:34.401742 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:34.403497 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:34.403694 1371 raft_consensus.cc:606] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 8 LEADER]: Received request to transfer leadership to TS 22f0fcdd6d614884843d6ef3bca6708f
I20251211 21:04:34.404072 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:34.404186 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:34.528339 2400 raft_consensus.cc:993] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:34.528441 2400 raft_consensus.cc:1081] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 8 LEADER]: Signalling peer 22f0fcdd6d614884843d6ef3bca6708f to start an election
I20251211 21:04:34.528905 1445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5145c85694243d88e619a1c643c6909"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
from {username='slave'} at 127.0.0.1:58074
I20251211 21:04:34.529032 1445 raft_consensus.cc:493] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:34.529093 1445 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 8 FOLLOWER]: Advancing to term 9
I20251211 21:04:34.529996 1445 raft_consensus.cc:515] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:34.530371 1445 leader_election.cc:290] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 9 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:34.530652 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 9 candidate_status { last_received { term: 8 index: 34 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:34.530658 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5145c85694243d88e619a1c643c6909" candidate_uuid: "22f0fcdd6d614884843d6ef3bca6708f" candidate_term: 9 candidate_status { last_received { term: 8 index: 34 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:34.530773 1371 raft_consensus.cc:3055] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 8 LEADER]: Stepping down as leader of term 8
I20251211 21:04:34.530787 1775 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 8 FOLLOWER]: Advancing to term 9
I20251211 21:04:34.530810 1371 raft_consensus.cc:740] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:34.530956 1371 consensus_queue.cc:260] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 8.34, Last appended by leader: 34, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:34.531105 1371 raft_consensus.cc:3060] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 8 FOLLOWER]: Advancing to term 9
I20251211 21:04:34.531819 1775 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 9.
I20251211 21:04:34.532012 1371 raft_consensus.cc:2468] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f0fcdd6d614884843d6ef3bca6708f in term 9.
I20251211 21:04:34.532181 1412 leader_election.cc:304] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2327d27b0bd449ea89201c0404e0915f; no voters:
I20251211 21:04:34.532371 2410 raft_consensus.cc:2804] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 9 FOLLOWER]: Leader election won for term 9
I20251211 21:04:34.532516 2410 raft_consensus.cc:697] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 9 LEADER]: Becoming Leader. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:34.532655 2410 consensus_queue.cc:237] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 8.34, Last appended by leader: 34, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:34.534070 1263 catalog_manager.cc:5654] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f reported cstate change: term changed from 8 to 9, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194). New cstate: current_term: 9 leader_uuid: "22f0fcdd6d614884843d6ef3bca6708f" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:34.983763 1371 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 9 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 8 index: 34. Preceding OpId from leader: term: 9 index: 35. (index mismatch)
I20251211 21:04:34.984151 2410 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251211 21:04:34.986604 1775 raft_consensus.cc:1275] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 9 FOLLOWER]: Refusing update from remote peer 22f0fcdd6d614884843d6ef3bca6708f: Log matching property violated. Preceding OpId in replica: term: 8 index: 34. Preceding OpId from leader: term: 9 index: 35. (index mismatch)
I20251211 21:04:34.987131 2410 consensus_queue.cc:1048] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251211 21:04:36.404448 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:36.406275 1445 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f04c059ecaa6400781a090ca30270262"
dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
mode: GRACEFUL
new_leader_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
from {username='slave'} at 127.0.0.1:58122
I20251211 21:04:36.406411 1445 raft_consensus.cc:606] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Received request to transfer leadership to TS aa211fd16a6744bbaa4bbb4545567bae
I20251211 21:04:36.406705 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:36.406805 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:36.899535 2445 raft_consensus.cc:993] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: : Instructing follower aa211fd16a6744bbaa4bbb4545567bae to start an election
I20251211 21:04:36.899665 2445 raft_consensus.cc:1081] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Signalling peer aa211fd16a6744bbaa4bbb4545567bae to start an election
I20251211 21:04:36.900086 1851 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f04c059ecaa6400781a090ca30270262"
dest_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
from {username='slave'} at 127.0.0.1:46958
I20251211 21:04:36.900218 1851 raft_consensus.cc:493] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:36.900264 1851 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:36.901088 1851 raft_consensus.cc:515] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:36.901520 1851 leader_election.cc:290] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [CANDIDATE]: Term 4 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), 2327d27b0bd449ea89201c0404e0915f (127.29.190.196:36747)
I20251211 21:04:36.901777 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "aa211fd16a6744bbaa4bbb4545567bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 33 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:36.901887 1445 raft_consensus.cc:3055] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Stepping down as leader of term 3
I20251211 21:04:36.901851 1775 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f04c059ecaa6400781a090ca30270262" candidate_uuid: "aa211fd16a6744bbaa4bbb4545567bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 33 } } ignore_live_leader: true dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
I20251211 21:04:36.901943 1445 raft_consensus.cc:740] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22f0fcdd6d614884843d6ef3bca6708f, State: Running, Role: LEADER
I20251211 21:04:36.901996 1775 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:36.902094 1445 consensus_queue.cc:260] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 3.33, Last appended by leader: 33, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:36.902238 1445 raft_consensus.cc:3060] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:36.902827 1775 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa211fd16a6744bbaa4bbb4545567bae in term 4.
I20251211 21:04:36.903014 1445 raft_consensus.cc:2468] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa211fd16a6744bbaa4bbb4545567bae in term 4.
I20251211 21:04:36.903128 1815 leader_election.cc:304] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2327d27b0bd449ea89201c0404e0915f, aa211fd16a6744bbaa4bbb4545567bae; no voters:
I20251211 21:04:36.903294 2431 raft_consensus.cc:2804] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 4 FOLLOWER]: Leader election won for term 4
I20251211 21:04:36.903493 2431 raft_consensus.cc:697] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 4 LEADER]: Becoming Leader. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Running, Role: LEADER
I20251211 21:04:36.903661 2431 consensus_queue.cc:237] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 3.33, Last appended by leader: 33, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } }
I20251211 21:04:36.905079 1261 catalog_manager.cc:5654] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae reported cstate change: term changed from 3 to 4, leader changed from 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194) to aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197). New cstate: current_term: 4 leader_uuid: "aa211fd16a6744bbaa4bbb4545567bae" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:37.356504 1775 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 4 index: 34. (index mismatch)
I20251211 21:04:37.356935 2431 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251211 21:04:37.359352 1445 raft_consensus.cc:1275] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Refusing update from remote peer aa211fd16a6744bbaa4bbb4545567bae: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 4 index: 34. (index mismatch)
I20251211 21:04:37.359854 2431 consensus_queue.cc:1048] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251211 21:04:38.407115 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:38.412422 1851 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7"
dest_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
mode: GRACEFUL
new_leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:55966
I20251211 21:04:38.412596 1851 raft_consensus.cc:606] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 3 LEADER]: Received request to transfer leadership to TS 2d3e56eb6a174c3eb932f4bcdc62e18c
I20251211 21:04:38.412901 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:38.413017 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:38.748170 2458 raft_consensus.cc:993] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: : Instructing follower 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:38.748271 2458 raft_consensus.cc:1081] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 3 LEADER]: Signalling peer 2d3e56eb6a174c3eb932f4bcdc62e18c to start an election
I20251211 21:04:38.748692 1371 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
from {username='slave'} at 127.0.0.1:32976
I20251211 21:04:38.748821 1371 raft_consensus.cc:493] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:38.748883 1371 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:38.749716 1371 raft_consensus.cc:515] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:38.750110 1371 leader_election.cc:290] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 4 election: Requested vote from peers 22f0fcdd6d614884843d6ef3bca6708f (127.29.190.194:34101), aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095)
I20251211 21:04:38.750387 1445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 30 } } ignore_live_leader: true dest_uuid: "22f0fcdd6d614884843d6ef3bca6708f"
I20251211 21:04:38.750487 1445 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:38.750468 1851 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605e369cbf1b4052b066b230cc165bb7" candidate_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 30 } } ignore_live_leader: true dest_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
I20251211 21:04:38.750617 1851 raft_consensus.cc:3055] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 3 LEADER]: Stepping down as leader of term 3
I20251211 21:04:38.750659 1851 raft_consensus.cc:740] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aa211fd16a6744bbaa4bbb4545567bae, State: Running, Role: LEADER
I20251211 21:04:38.750800 1851 consensus_queue.cc:260] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 3.30, Last appended by leader: 30, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:38.750952 1851 raft_consensus.cc:3060] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 3 FOLLOWER]: Advancing to term 4
I20251211 21:04:38.751372 1445 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 4.
I20251211 21:04:38.751664 1335 leader_election.cc:304] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f0fcdd6d614884843d6ef3bca6708f, 2d3e56eb6a174c3eb932f4bcdc62e18c; no voters:
I20251211 21:04:38.751816 2400 raft_consensus.cc:2804] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Leader election won for term 4
I20251211 21:04:38.751874 1851 raft_consensus.cc:2468] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e56eb6a174c3eb932f4bcdc62e18c in term 4.
I20251211 21:04:38.751960 2400 raft_consensus.cc:697] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Becoming Leader. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:38.752099 2400 consensus_queue.cc:237] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 3.30, Last appended by leader: 30, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:38.753752 1263 catalog_manager.cc:5654] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c reported cstate change: term changed from 3 to 4, leader changed from aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197) to 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193). New cstate: current_term: 4 leader_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:39.184652 1851 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 4 index: 31. (index mismatch)
I20251211 21:04:39.185055 2400 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:39.188098 1445 raft_consensus.cc:1275] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Refusing update from remote peer 2d3e56eb6a174c3eb932f4bcdc62e18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 4 index: 31. (index mismatch)
I20251211 21:04:39.188766 2470 consensus_queue.cc:1048] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f0fcdd6d614884843d6ef3bca6708f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251211 21:04:40.413383 1323 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:40.415107 1371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
mode: GRACEFUL
new_leader_uuid: "2327d27b0bd449ea89201c0404e0915f"
from {username='slave'} at 127.0.0.1:40802
I20251211 21:04:40.415263 1371 raft_consensus.cc:606] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Received request to transfer leadership to TS 2327d27b0bd449ea89201c0404e0915f
I20251211 21:04:40.415665 1323 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:40.415802 1323 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:40.873505 2470 raft_consensus.cc:993] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: : Instructing follower 2327d27b0bd449ea89201c0404e0915f to start an election
I20251211 21:04:40.873615 2470 raft_consensus.cc:1081] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Signalling peer 2327d27b0bd449ea89201c0404e0915f to start an election
I20251211 21:04:40.874025 1775 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8"
dest_uuid: "2327d27b0bd449ea89201c0404e0915f"
from {username='slave'} at 127.0.0.1:38794
I20251211 21:04:40.874157 1775 raft_consensus.cc:493] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:40.874219 1775 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 6 FOLLOWER]: Advancing to term 7
I20251211 21:04:40.876060 1775 raft_consensus.cc:515] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:40.876525 1775 leader_election.cc:290] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [CANDIDATE]: Term 7 election: Requested vote from peers 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193:33469), aa211fd16a6744bbaa4bbb4545567bae (127.29.190.197:43095)
I20251211 21:04:40.876863 1851 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2327d27b0bd449ea89201c0404e0915f" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: true dest_uuid: "aa211fd16a6744bbaa4bbb4545567bae"
I20251211 21:04:40.876982 1851 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 6 FOLLOWER]: Advancing to term 7
I20251211 21:04:40.876963 1371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9afcbdf999514a22badd7550b63d8cb8" candidate_uuid: "2327d27b0bd449ea89201c0404e0915f" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: true dest_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c"
I20251211 21:04:40.877108 1371 raft_consensus.cc:3055] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Stepping down as leader of term 6
I20251211 21:04:40.877164 1371 raft_consensus.cc:740] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d3e56eb6a174c3eb932f4bcdc62e18c, State: Running, Role: LEADER
I20251211 21:04:40.877346 1371 consensus_queue.cc:260] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 6.35, Last appended by leader: 35, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:40.877528 1371 raft_consensus.cc:3060] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 6 FOLLOWER]: Advancing to term 7
I20251211 21:04:40.877869 1851 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2327d27b0bd449ea89201c0404e0915f in term 7.
I20251211 21:04:40.878172 1739 leader_election.cc:304] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2327d27b0bd449ea89201c0404e0915f, aa211fd16a6744bbaa4bbb4545567bae; no voters:
I20251211 21:04:40.878357 2324 raft_consensus.cc:2804] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 7 FOLLOWER]: Leader election won for term 7
I20251211 21:04:40.878484 1371 raft_consensus.cc:2468] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2327d27b0bd449ea89201c0404e0915f in term 7.
I20251211 21:04:40.878523 2324 raft_consensus.cc:697] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 7 LEADER]: Becoming Leader. State: Replica: 2327d27b0bd449ea89201c0404e0915f, State: Running, Role: LEADER
I20251211 21:04:40.878654 2324 consensus_queue.cc:237] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 6.35, Last appended by leader: 35, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } }
I20251211 21:04:40.880265 1261 catalog_manager.cc:5654] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f reported cstate change: term changed from 6 to 7, leader changed from 2d3e56eb6a174c3eb932f4bcdc62e18c (127.29.190.193) to 2327d27b0bd449ea89201c0404e0915f (127.29.190.196). New cstate: current_term: 7 leader_uuid: "2327d27b0bd449ea89201c0404e0915f" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2327d27b0bd449ea89201c0404e0915f" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 36747 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:41.264065 1851 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 7 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 6 index: 35. Preceding OpId from leader: term: 7 index: 36. (index mismatch)
I20251211 21:04:41.264544 2324 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa211fd16a6744bbaa4bbb4545567bae" member_type: VOTER last_known_addr { host: "127.29.190.197" port: 43095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20251211 21:04:41.266959 1371 raft_consensus.cc:1275] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 7 FOLLOWER]: Refusing update from remote peer 2327d27b0bd449ea89201c0404e0915f: Log matching property violated. Preceding OpId in replica: term: 6 index: 35. Preceding OpId from leader: term: 7 index: 36. (index mismatch)
I20251211 21:04:41.267328 2475 consensus_queue.cc:1048] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3e56eb6a174c3eb932f4bcdc62e18c" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/auto_rebalancer-test.cc:196: Failure
Expected equality of these values:
0
NumMovesScheduled(leader_idx, BalanceThreadType::LEADER_REBALANCE)
Which is: 1
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:403: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/auto_rebalancer-test.cc:575: Failure
Expected: CheckNoLeaderMovesScheduled() doesn't generate new fatal failures in the current thread.
Actual: it does.
I20251211 21:04:42.065230 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:04:42.069305 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:42.069568 30459 tablet_replica.cc:333] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:42.069700 30459 raft_consensus.cc:2243] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.069958 30459 raft_consensus.cc:2272] T 605e369cbf1b4052b066b230cc165bb7 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.070431 30459 tablet_replica.cc:333] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:42.070528 30459 raft_consensus.cc:2243] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.070623 30459 raft_consensus.cc:2272] T 77c000525583471e957c31b719d95ea0 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.070976 30459 tablet_replica.cc:333] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:42.071050 30459 raft_consensus.cc:2243] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 9 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.071133 30459 raft_consensus.cc:2272] T b5145c85694243d88e619a1c643c6909 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 9 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.071458 30459 tablet_replica.cc:333] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:42.071532 30459 raft_consensus.cc:2243] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.071722 30459 raft_consensus.cc:2272] T e90566476d56419683b3518348f96603 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.072039 30459 tablet_replica.cc:333] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:42.072113 30459 raft_consensus.cc:2243] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.072230 30459 raft_consensus.cc:2272] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.072527 30459 tablet_replica.cc:333] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c: stopping tablet replica
I20251211 21:04:42.072597 30459 raft_consensus.cc:2243] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 7 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.072698 30459 raft_consensus.cc:2272] T 9afcbdf999514a22badd7550b63d8cb8 P 2d3e56eb6a174c3eb932f4bcdc62e18c [term 7 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.087761 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:04:42.091150 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:04:42.095502 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:42.095744 30459 tablet_replica.cc:333] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:42.095871 30459 raft_consensus.cc:2243] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 5 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.095992 30459 raft_consensus.cc:2272] T 9b336d873366440aa05f76b89a75710a P 22f0fcdd6d614884843d6ef3bca6708f [term 5 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.096443 30459 tablet_replica.cc:333] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:42.096547 30459 raft_consensus.cc:2243] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.096642 30459 raft_consensus.cc:2272] T 605e369cbf1b4052b066b230cc165bb7 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.096972 30459 tablet_replica.cc:333] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:42.097056 30459 raft_consensus.cc:2243] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.097139 30459 raft_consensus.cc:2272] T f04c059ecaa6400781a090ca30270262 P 22f0fcdd6d614884843d6ef3bca6708f [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.097436 30459 tablet_replica.cc:333] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:42.097522 30459 raft_consensus.cc:2243] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.097694 30459 raft_consensus.cc:2272] T 70e1f34692834e4cb9ffbdbbbc356141 P 22f0fcdd6d614884843d6ef3bca6708f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.097997 30459 tablet_replica.cc:333] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:42.098076 30459 raft_consensus.cc:2243] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.098187 30459 raft_consensus.cc:2272] T c94dc3e2fd5d4db3aa515604c847331f P 22f0fcdd6d614884843d6ef3bca6708f [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.098481 30459 tablet_replica.cc:333] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f: stopping tablet replica
I20251211 21:04:42.098564 30459 raft_consensus.cc:2243] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 9 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.098716 30459 raft_consensus.cc:2272] T b5145c85694243d88e619a1c643c6909 P 22f0fcdd6d614884843d6ef3bca6708f [term 9 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.113741 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:04:42.117223 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:04:42.122613 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:42.122875 30459 tablet_replica.cc:333] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:42.123021 30459 raft_consensus.cc:2243] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.123185 30459 raft_consensus.cc:2272] T 9b336d873366440aa05f76b89a75710a P 5eec57358d0f4ba48d683b4c7d445454 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.123726 30459 tablet_replica.cc:333] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:42.123821 30459 raft_consensus.cc:2243] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.123952 30459 raft_consensus.cc:2272] T 77c000525583471e957c31b719d95ea0 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.124295 30459 tablet_replica.cc:333] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:42.124380 30459 raft_consensus.cc:2243] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.124514 30459 raft_consensus.cc:2272] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.124845 30459 tablet_replica.cc:333] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:42.124922 30459 raft_consensus.cc:2243] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.125082 30459 raft_consensus.cc:2272] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.125423 30459 tablet_replica.cc:333] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:42.125536 30459 raft_consensus.cc:2243] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 3 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.125695 30459 raft_consensus.cc:2272] T 91d55fcc7df346549c84ae6cfdcf36ad P 5eec57358d0f4ba48d683b4c7d445454 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.126022 30459 tablet_replica.cc:333] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454: stopping tablet replica
I20251211 21:04:42.126093 30459 raft_consensus.cc:2243] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.126178 30459 raft_consensus.cc:2272] T e90566476d56419683b3518348f96603 P 5eec57358d0f4ba48d683b4c7d445454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.140106 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:04:42.143386 30459 tablet_server.cc:178] TabletServer@127.29.190.196:0 shutting down...
I20251211 21:04:42.147470 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:42.147722 30459 tablet_replica.cc:333] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f: stopping tablet replica
I20251211 21:04:42.147853 30459 raft_consensus.cc:2243] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 9 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.147981 30459 raft_consensus.cc:2272] T b5145c85694243d88e619a1c643c6909 P 2327d27b0bd449ea89201c0404e0915f [term 9 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.148404 30459 tablet_replica.cc:333] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f: stopping tablet replica
I20251211 21:04:42.148487 30459 raft_consensus.cc:2243] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.148641 30459 raft_consensus.cc:2272] T 77c000525583471e957c31b719d95ea0 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.148958 30459 tablet_replica.cc:333] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f: stopping tablet replica
I20251211 21:04:42.149034 30459 raft_consensus.cc:2243] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 7 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.149163 30459 raft_consensus.cc:2272] T 9afcbdf999514a22badd7550b63d8cb8 P 2327d27b0bd449ea89201c0404e0915f [term 7 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.149601 30459 tablet_replica.cc:333] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f: stopping tablet replica
I20251211 21:04:42.149685 30459 raft_consensus.cc:2243] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.149775 30459 raft_consensus.cc:2272] T f04c059ecaa6400781a090ca30270262 P 2327d27b0bd449ea89201c0404e0915f [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.150046 30459 tablet_replica.cc:333] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f: stopping tablet replica
I20251211 21:04:42.150116 30459 raft_consensus.cc:2243] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.150238 30459 raft_consensus.cc:2272] T 2e0e0cc37a5b41fd90c461aff17e8d28 P 2327d27b0bd449ea89201c0404e0915f [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.150506 30459 tablet_replica.cc:333] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f: stopping tablet replica
I20251211 21:04:42.150568 30459 raft_consensus.cc:2243] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.150683 30459 raft_consensus.cc:2272] T 91d55fcc7df346549c84ae6cfdcf36ad P 2327d27b0bd449ea89201c0404e0915f [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.164136 30459 tablet_server.cc:195] TabletServer@127.29.190.196:0 shutdown complete.
I20251211 21:04:42.166980 30459 tablet_server.cc:178] TabletServer@127.29.190.197:0 shutting down...
I20251211 21:04:42.171036 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:42.171249 30459 tablet_replica.cc:333] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae: stopping tablet replica
I20251211 21:04:42.171376 30459 raft_consensus.cc:2243] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 7 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.171530 30459 raft_consensus.cc:2272] T 9afcbdf999514a22badd7550b63d8cb8 P aa211fd16a6744bbaa4bbb4545567bae [term 7 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.172210 30459 tablet_replica.cc:333] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae: stopping tablet replica
I20251211 21:04:42.172335 30459 raft_consensus.cc:2243] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.172492 30459 raft_consensus.cc:2272] T 70e1f34692834e4cb9ffbdbbbc356141 P aa211fd16a6744bbaa4bbb4545567bae [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.172871 30459 tablet_replica.cc:333] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae: stopping tablet replica
I20251211 21:04:42.172969 30459 raft_consensus.cc:2243] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.173091 30459 raft_consensus.cc:2272] T 2e0e0cc37a5b41fd90c461aff17e8d28 P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.173436 30459 tablet_replica.cc:333] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae: stopping tablet replica
I20251211 21:04:42.173522 30459 raft_consensus.cc:2243] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 4 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.173694 30459 raft_consensus.cc:2272] T f04c059ecaa6400781a090ca30270262 P aa211fd16a6744bbaa4bbb4545567bae [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.174010 30459 tablet_replica.cc:333] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae: stopping tablet replica
I20251211 21:04:42.174085 30459 raft_consensus.cc:2243] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 4 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.174178 30459 raft_consensus.cc:2272] T 605e369cbf1b4052b066b230cc165bb7 P aa211fd16a6744bbaa4bbb4545567bae [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.174468 30459 tablet_replica.cc:333] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae: stopping tablet replica
I20251211 21:04:42.174540 30459 raft_consensus.cc:2243] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.174685 30459 raft_consensus.cc:2272] T c94dc3e2fd5d4db3aa515604c847331f P aa211fd16a6744bbaa4bbb4545567bae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.188920 30459 tablet_server.cc:195] TabletServer@127.29.190.197:0 shutdown complete.
I20251211 21:04:42.191663 30459 tablet_server.cc:178] TabletServer@127.29.190.198:0 shutting down...
I20251211 21:04:42.195494 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:42.195719 30459 tablet_replica.cc:333] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061: stopping tablet replica
I20251211 21:04:42.195848 30459 raft_consensus.cc:2243] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.195987 30459 raft_consensus.cc:2272] T 91d55fcc7df346549c84ae6cfdcf36ad P f5074d327f094246ad9acb355421d061 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.196447 30459 tablet_replica.cc:333] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061: stopping tablet replica
I20251211 21:04:42.196553 30459 raft_consensus.cc:2243] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.196666 30459 raft_consensus.cc:2272] T c94dc3e2fd5d4db3aa515604c847331f P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.197007 30459 tablet_replica.cc:333] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061: stopping tablet replica
I20251211 21:04:42.197093 30459 raft_consensus.cc:2243] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 5 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.197253 30459 raft_consensus.cc:2272] T 9b336d873366440aa05f76b89a75710a P f5074d327f094246ad9acb355421d061 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.197575 30459 tablet_replica.cc:333] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061: stopping tablet replica
I20251211 21:04:42.197662 30459 raft_consensus.cc:2243] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.197760 30459 raft_consensus.cc:2272] T 70e1f34692834e4cb9ffbdbbbc356141 P f5074d327f094246ad9acb355421d061 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.198061 30459 tablet_replica.cc:333] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061: stopping tablet replica
I20251211 21:04:42.198145 30459 raft_consensus.cc:2243] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.198246 30459 raft_consensus.cc:2272] T 3164db1c791a4cd7b4f9057f5f5e0cd9 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.198549 30459 tablet_replica.cc:333] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061: stopping tablet replica
I20251211 21:04:42.198623 30459 raft_consensus.cc:2243] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:42.198724 30459 raft_consensus.cc:2272] T e90566476d56419683b3518348f96603 P f5074d327f094246ad9acb355421d061 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.211826 30459 tablet_server.cc:195] TabletServer@127.29.190.198:0 shutdown complete.
I20251211 21:04:42.214599 30459 master.cc:561] Master@127.29.190.254:45383 shutting down...
I20251211 21:04:42.218191 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:04:42.218376 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:42.218449 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 07ec112d609342b2a41f60a6b9e38340: stopping tablet replica
I20251211 21:04:42.231374 30459 master.cc:583] Master@127.29.190.254:45383 shutdown complete.
I20251211 21:04:42.235132 30459 test_util.cc:183] -----------------------------------------------
I20251211 21:04:42.235188 30459 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765486953797919-30459-0
[ FAILED ] AutoRebalancerTest.TestMaxMovesPerServer (35957 ms)
[ RUN ] AutoRebalancerTest.AutoRebalancingUnstableCluster
I20251211 21:04:42.235931 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:44101
I20251211 21:04:42.236270 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:42.238029 2491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:42.238024 2493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:42.238168 2490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:42.238366 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:42.238498 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:42.238530 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:42.238549 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487082238549 us; error 0 us; skew 500 ppm
I20251211 21:04:42.239511 30459 webserver.cc:492] Webserver started at http://127.29.190.254:33395/ using document root <none> and password file <none>
I20251211 21:04:42.239754 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:42.239818 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:42.239892 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:42.240332 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "4b985690ce5044b098174c92b7e522da"
format_stamp: "Formatted at 2025-12-11 21:04:42 on dist-test-slave-xjj2"
I20251211 21:04:42.242465 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:42.243716 2498 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.244007 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:42.244086 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "4b985690ce5044b098174c92b7e522da"
format_stamp: "Formatted at 2025-12-11 21:04:42 on dist-test-slave-xjj2"
I20251211 21:04:42.244160 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:42.258427 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:42.258808 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:42.263842 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:44101
I20251211 21:04:42.270762 2550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:44101 every 8 connection(s)
I20251211 21:04:42.271374 2551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:42.273532 2551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da: Bootstrap starting.
I20251211 21:04:42.274425 2551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:42.275575 2551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da: No bootstrap required, opened a new log
I20251211 21:04:42.276016 2551 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b985690ce5044b098174c92b7e522da" member_type: VOTER }
I20251211 21:04:42.276114 2551 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:42.276139 2551 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b985690ce5044b098174c92b7e522da, State: Initialized, Role: FOLLOWER
I20251211 21:04:42.276260 2551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b985690ce5044b098174c92b7e522da" member_type: VOTER }
I20251211 21:04:42.276326 2551 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:04:42.276360 2551 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:04:42.276412 2551 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:42.277197 2551 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b985690ce5044b098174c92b7e522da" member_type: VOTER }
I20251211 21:04:42.277331 2551 leader_election.cc:304] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b985690ce5044b098174c92b7e522da; no voters:
I20251211 21:04:42.277534 2551 leader_election.cc:290] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:04:42.277683 2554 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:42.277971 2554 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 1 LEADER]: Becoming Leader. State: Replica: 4b985690ce5044b098174c92b7e522da, State: Running, Role: LEADER
I20251211 21:04:42.278105 2554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b985690ce5044b098174c92b7e522da" member_type: VOTER }
I20251211 21:04:42.278105 2551 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:04:42.278571 2555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b985690ce5044b098174c92b7e522da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b985690ce5044b098174c92b7e522da" member_type: VOTER } }
I20251211 21:04:42.278663 2555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [sys.catalog]: This master's current role is: LEADER
I20251211 21:04:42.278837 2556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b985690ce5044b098174c92b7e522da. Latest consensus state: current_term: 1 leader_uuid: "4b985690ce5044b098174c92b7e522da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b985690ce5044b098174c92b7e522da" member_type: VOTER } }
I20251211 21:04:42.278910 2556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [sys.catalog]: This master's current role is: LEADER
I20251211 21:04:42.278928 2558 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:04:42.279803 2558 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:04:42.280189 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:04:42.281548 2558 catalog_manager.cc:1357] Generated new cluster ID: a4e9eeaeffad43869f4d27d3ef6f8941
I20251211 21:04:42.281605 2558 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:04:42.288502 2558 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:04:42.289075 2558 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:04:42.301304 2558 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da: Generated new TSK 0
I20251211 21:04:42.301518 2558 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:04:42.312484 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:42.314258 2575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:42.314328 2572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:42.314406 2573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:42.314494 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:42.314709 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:42.314747 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:42.314761 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487082314761 us; error 0 us; skew 500 ppm
I20251211 21:04:42.315806 30459 webserver.cc:492] Webserver started at http://127.29.190.193:35131/ using document root <none> and password file <none>
I20251211 21:04:42.315945 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:42.315991 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:42.316048 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:42.316409 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "b06f71098455456d8ba52ded14c9008a"
format_stamp: "Formatted at 2025-12-11 21:04:42 on dist-test-slave-xjj2"
I20251211 21:04:42.317759 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:04:42.318603 2580 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.318823 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:42.318881 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "b06f71098455456d8ba52ded14c9008a"
format_stamp: "Formatted at 2025-12-11 21:04:42 on dist-test-slave-xjj2"
I20251211 21:04:42.318945 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:42.331471 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:42.331884 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:42.332108 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:42.332564 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:42.332602 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.332631 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:42.332659 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.336534 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:40497
I20251211 21:04:42.336555 2643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:40497 every 8 connection(s)
I20251211 21:04:42.337406 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:42.338976 2648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:42.339062 2651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:42.339125 2649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:42.339344 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:42.339458 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:42.339483 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:42.339496 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487082339495 us; error 0 us; skew 500 ppm
I20251211 21:04:42.340416 30459 webserver.cc:492] Webserver started at http://127.29.190.194:33389/ using document root <none> and password file <none>
I20251211 21:04:42.340579 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:42.340631 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:42.340698 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:42.341038 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "67756136aa6d46d0a56bf728de0c1070"
format_stamp: "Formatted at 2025-12-11 21:04:42 on dist-test-slave-xjj2"
I20251211 21:04:42.342480 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:42.343449 2656 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.343747 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:42.343827 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "67756136aa6d46d0a56bf728de0c1070"
format_stamp: "Formatted at 2025-12-11 21:04:42 on dist-test-slave-xjj2"
I20251211 21:04:42.343904 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:42.345484 2644 heartbeater.cc:344] Connected to a master server at 127.29.190.254:44101
I20251211 21:04:42.345577 2644 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:42.345796 2644 heartbeater.cc:507] Master 127.29.190.254:44101 requested a full tablet report, sending...
I20251211 21:04:42.346354 2515 ts_manager.cc:194] Registered new tserver with Master: b06f71098455456d8ba52ded14c9008a (127.29.190.193:40497)
I20251211 21:04:42.347051 2515 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37604
I20251211 21:04:42.355448 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:42.355907 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:42.356190 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:42.356652 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:42.356689 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.356729 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:42.356756 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.360742 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:45285
I20251211 21:04:42.360787 2719 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:45285 every 8 connection(s)
I20251211 21:04:42.361485 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:42.363217 2724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:42.363227 2726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:42.363310 2723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:42.363520 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:42.363692 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:42.363740 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:42.363759 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487082363759 us; error 0 us; skew 500 ppm
I20251211 21:04:42.364675 30459 webserver.cc:492] Webserver started at http://127.29.190.195:42403/ using document root <none> and password file <none>
I20251211 21:04:42.364828 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:42.364888 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:42.364964 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:42.365388 2720 heartbeater.cc:344] Connected to a master server at 127.29.190.254:44101
I20251211 21:04:42.365481 2720 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:42.365473 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "41542f7400d44e84b2a8076718d1fe2c"
format_stamp: "Formatted at 2025-12-11 21:04:42 on dist-test-slave-xjj2"
I20251211 21:04:42.365703 2720 heartbeater.cc:507] Master 127.29.190.254:44101 requested a full tablet report, sending...
I20251211 21:04:42.366303 2515 ts_manager.cc:194] Registered new tserver with Master: 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194:45285)
I20251211 21:04:42.366945 2515 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37614
I20251211 21:04:42.367161 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:04:42.368039 2731 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.368252 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:42.368314 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "41542f7400d44e84b2a8076718d1fe2c"
format_stamp: "Formatted at 2025-12-11 21:04:42 on dist-test-slave-xjj2"
I20251211 21:04:42.368378 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:42.391189 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:42.391589 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:42.391929 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:42.392414 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:42.392454 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.392496 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:42.392524 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:42.396368 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:39751
I20251211 21:04:42.396440 2794 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:39751 every 8 connection(s)
I20251211 21:04:42.400600 2795 heartbeater.cc:344] Connected to a master server at 127.29.190.254:44101
I20251211 21:04:42.400709 2795 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:42.400907 2795 heartbeater.cc:507] Master 127.29.190.254:44101 requested a full tablet report, sending...
I20251211 21:04:42.401443 2515 ts_manager.cc:194] Registered new tserver with Master: 41542f7400d44e84b2a8076718d1fe2c (127.29.190.195:39751)
I20251211 21:04:42.401964 2515 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37628
I20251211 21:04:42.402338 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005573181s
I20251211 21:04:43.347956 2644 heartbeater.cc:499] Master 127.29.190.254:44101 was elected leader, sending a full tablet report...
I20251211 21:04:43.367826 2720 heartbeater.cc:499] Master 127.29.190.254:44101 was elected leader, sending a full tablet report...
I20251211 21:04:43.402876 2795 heartbeater.cc:499] Master 127.29.190.254:44101 was elected leader, sending a full tablet report...
I20251211 21:04:43.428632 30459 test_util.cc:276] Using random seed: 2121702165
I20251211 21:04:43.436434 2515 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47660:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\252\252\252*\004\001\000TUUU""\004\001\000\252\252\252*\004\001\000TUUU"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:04:43.436980 2515 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:04:43.447301 2684 tablet_service.cc:1505] Processing CreateTablet for tablet 060a95dd8f794561b938d0d0e5a76ff8 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION VALUES < 715827882
I20251211 21:04:43.447713 2684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060a95dd8f794561b938d0d0e5a76ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.448482 2608 tablet_service.cc:1505] Processing CreateTablet for tablet 060a95dd8f794561b938d0d0e5a76ff8 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION VALUES < 715827882
I20251211 21:04:43.448541 2607 tablet_service.cc:1505] Processing CreateTablet for tablet e08eba0724584cbf99028f322b3ac621 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20251211 21:04:43.448541 2606 tablet_service.cc:1505] Processing CreateTablet for tablet 92f2eb9a47f84d8794cee32c3c220ca3 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20251211 21:04:43.448758 2608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060a95dd8f794561b938d0d0e5a76ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.448906 2607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08eba0724584cbf99028f322b3ac621. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.449039 2606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f2eb9a47f84d8794cee32c3c220ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.449574 2683 tablet_service.cc:1505] Processing CreateTablet for tablet e08eba0724584cbf99028f322b3ac621 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20251211 21:04:43.449796 2683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08eba0724584cbf99028f322b3ac621. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.451742 2816 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070: Bootstrap starting.
I20251211 21:04:43.452036 2758 tablet_service.cc:1505] Processing CreateTablet for tablet 060a95dd8f794561b938d0d0e5a76ff8 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION VALUES < 715827882
I20251211 21:04:43.452080 2759 tablet_service.cc:1505] Processing CreateTablet for tablet e08eba0724584cbf99028f322b3ac621 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20251211 21:04:43.452303 2759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08eba0724584cbf99028f322b3ac621. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.452392 2757 tablet_service.cc:1505] Processing CreateTablet for tablet 92f2eb9a47f84d8794cee32c3c220ca3 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20251211 21:04:43.452597 2757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f2eb9a47f84d8794cee32c3c220ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.452652 2816 tablet_bootstrap.cc:654] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.453536 2682 tablet_service.cc:1505] Processing CreateTablet for tablet 92f2eb9a47f84d8794cee32c3c220ca3 (DEFAULT_TABLE table=test-workload [id=270d18714cb4490a82a0d7ba058c97a1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20251211 21:04:43.453611 2816 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070: No bootstrap required, opened a new log
I20251211 21:04:43.453693 2816 ts_tablet_manager.cc:1403] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:04:43.453763 2682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f2eb9a47f84d8794cee32c3c220ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.454130 2816 raft_consensus.cc:359] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.454226 2816 raft_consensus.cc:385] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.454252 2816 raft_consensus.cc:740] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67756136aa6d46d0a56bf728de0c1070, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.454352 2758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060a95dd8f794561b938d0d0e5a76ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:43.454371 2816 consensus_queue.cc:260] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.454725 2816 ts_tablet_manager.cc:1434] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:43.455595 2816 tablet_bootstrap.cc:492] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070: Bootstrap starting.
I20251211 21:04:43.456554 2816 tablet_bootstrap.cc:654] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.456790 2818 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c: Bootstrap starting.
I20251211 21:04:43.456825 2815 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: Bootstrap starting.
I20251211 21:04:43.457695 2815 tablet_bootstrap.cc:654] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.457759 2818 tablet_bootstrap.cc:654] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.458201 2816 tablet_bootstrap.cc:492] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070: No bootstrap required, opened a new log
I20251211 21:04:43.458292 2816 ts_tablet_manager.cc:1403] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251211 21:04:43.458701 2815 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: No bootstrap required, opened a new log
I20251211 21:04:43.458803 2818 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c: No bootstrap required, opened a new log
I20251211 21:04:43.458774 2816 raft_consensus.cc:359] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.458832 2815 ts_tablet_manager.cc:1403] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:43.458875 2818 ts_tablet_manager.cc:1403] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:43.458880 2816 raft_consensus.cc:385] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.458986 2816 raft_consensus.cc:740] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67756136aa6d46d0a56bf728de0c1070, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.459138 2816 consensus_queue.cc:260] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.459270 2815 raft_consensus.cc:359] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.459349 2815 raft_consensus.cc:385] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.459393 2815 raft_consensus.cc:740] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06f71098455456d8ba52ded14c9008a, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.459528 2815 consensus_queue.cc:260] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.459700 2818 raft_consensus.cc:359] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.459796 2818 raft_consensus.cc:385] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.459828 2818 raft_consensus.cc:740] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41542f7400d44e84b2a8076718d1fe2c, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.459895 2815 ts_tablet_manager.cc:1434] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:43.459937 2818 consensus_queue.cc:260] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.460067 2815 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: Bootstrap starting.
I20251211 21:04:43.460369 2818 ts_tablet_manager.cc:1434] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:43.461024 2816 ts_tablet_manager.cc:1434] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251211 21:04:43.461045 2815 tablet_bootstrap.cc:654] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.461865 2816 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: Bootstrap starting.
I20251211 21:04:43.462399 2818 tablet_bootstrap.cc:492] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c: Bootstrap starting.
I20251211 21:04:43.462776 2816 tablet_bootstrap.cc:654] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.463179 2818 tablet_bootstrap.cc:654] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.463830 2816 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: No bootstrap required, opened a new log
I20251211 21:04:43.463920 2816 ts_tablet_manager.cc:1403] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251211 21:04:43.464280 2818 tablet_bootstrap.cc:492] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c: No bootstrap required, opened a new log
I20251211 21:04:43.464385 2818 ts_tablet_manager.cc:1403] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:04:43.464293 2816 raft_consensus.cc:359] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.464632 2816 raft_consensus.cc:385] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.464665 2816 raft_consensus.cc:740] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67756136aa6d46d0a56bf728de0c1070, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.464742 2815 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: No bootstrap required, opened a new log
I20251211 21:04:43.464820 2815 ts_tablet_manager.cc:1403] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20251211 21:04:43.464784 2816 consensus_queue.cc:260] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.465058 2816 ts_tablet_manager.cc:1434] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:43.465210 2815 raft_consensus.cc:359] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.465298 2815 raft_consensus.cc:385] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.465329 2815 raft_consensus.cc:740] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06f71098455456d8ba52ded14c9008a, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.465449 2815 consensus_queue.cc:260] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.465767 2815 ts_tablet_manager.cc:1434] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:04:43.465915 2815 tablet_bootstrap.cc:492] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a: Bootstrap starting.
I20251211 21:04:43.466763 2815 tablet_bootstrap.cc:654] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.467819 2815 tablet_bootstrap.cc:492] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a: No bootstrap required, opened a new log
I20251211 21:04:43.467796 2818 raft_consensus.cc:359] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.467887 2818 raft_consensus.cc:385] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.467927 2815 ts_tablet_manager.cc:1403] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251211 21:04:43.467931 2818 raft_consensus.cc:740] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41542f7400d44e84b2a8076718d1fe2c, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.468067 2818 consensus_queue.cc:260] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.468291 2818 ts_tablet_manager.cc:1434] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251211 21:04:43.468484 2818 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c: Bootstrap starting.
I20251211 21:04:43.468487 2815 raft_consensus.cc:359] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.468607 2815 raft_consensus.cc:385] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.468647 2815 raft_consensus.cc:740] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06f71098455456d8ba52ded14c9008a, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.468748 2815 consensus_queue.cc:260] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.469013 2815 ts_tablet_manager.cc:1434] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:43.469533 2818 tablet_bootstrap.cc:654] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:43.470531 2818 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c: No bootstrap required, opened a new log
I20251211 21:04:43.470611 2818 ts_tablet_manager.cc:1403] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:43.470988 2818 raft_consensus.cc:359] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.471069 2818 raft_consensus.cc:385] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:43.471097 2818 raft_consensus.cc:740] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41542f7400d44e84b2a8076718d1fe2c, State: Initialized, Role: FOLLOWER
I20251211 21:04:43.471205 2818 consensus_queue.cc:260] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.471419 2818 ts_tablet_manager.cc:1434] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:43.486546 2824 raft_consensus.cc:493] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:43.486703 2824 raft_consensus.cc:515] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.487200 2824 leader_election.cc:290] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06f71098455456d8ba52ded14c9008a (127.29.190.193:40497), 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194:45285)
I20251211 21:04:43.490557 2618 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08eba0724584cbf99028f322b3ac621" candidate_uuid: "41542f7400d44e84b2a8076718d1fe2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06f71098455456d8ba52ded14c9008a" is_pre_election: true
I20251211 21:04:43.490592 2694 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08eba0724584cbf99028f322b3ac621" candidate_uuid: "41542f7400d44e84b2a8076718d1fe2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67756136aa6d46d0a56bf728de0c1070" is_pre_election: true
I20251211 21:04:43.490738 2618 raft_consensus.cc:2468] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41542f7400d44e84b2a8076718d1fe2c in term 0.
I20251211 21:04:43.490747 2694 raft_consensus.cc:2468] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41542f7400d44e84b2a8076718d1fe2c in term 0.
I20251211 21:04:43.491037 2735 leader_election.cc:304] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41542f7400d44e84b2a8076718d1fe2c, 67756136aa6d46d0a56bf728de0c1070; no voters:
I20251211 21:04:43.491199 2824 raft_consensus.cc:2804] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:43.491257 2824 raft_consensus.cc:493] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:43.491284 2824 raft_consensus.cc:3060] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.492130 2824 raft_consensus.cc:515] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.492466 2824 leader_election.cc:290] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [CANDIDATE]: Term 1 election: Requested vote from peers b06f71098455456d8ba52ded14c9008a (127.29.190.193:40497), 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194:45285)
I20251211 21:04:43.492760 2618 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08eba0724584cbf99028f322b3ac621" candidate_uuid: "41542f7400d44e84b2a8076718d1fe2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06f71098455456d8ba52ded14c9008a"
I20251211 21:04:43.492810 2694 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e08eba0724584cbf99028f322b3ac621" candidate_uuid: "41542f7400d44e84b2a8076718d1fe2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67756136aa6d46d0a56bf728de0c1070"
I20251211 21:04:43.492861 2618 raft_consensus.cc:3060] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.492908 2694 raft_consensus.cc:3060] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.493692 2694 raft_consensus.cc:2468] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41542f7400d44e84b2a8076718d1fe2c in term 1.
I20251211 21:04:43.493711 2618 raft_consensus.cc:2468] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41542f7400d44e84b2a8076718d1fe2c in term 1.
I20251211 21:04:43.493922 2735 leader_election.cc:304] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41542f7400d44e84b2a8076718d1fe2c, 67756136aa6d46d0a56bf728de0c1070; no voters:
I20251211 21:04:43.494072 2824 raft_consensus.cc:2804] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:43.494269 2824 raft_consensus.cc:697] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Becoming Leader. State: Replica: 41542f7400d44e84b2a8076718d1fe2c, State: Running, Role: LEADER
I20251211 21:04:43.494405 2824 consensus_queue.cc:237] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.495882 2514 catalog_manager.cc:5654] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 41542f7400d44e84b2a8076718d1fe2c (127.29.190.195). New cstate: current_term: 1 leader_uuid: "41542f7400d44e84b2a8076718d1fe2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } health_report { overall_health: HEALTHY } } }
I20251211 21:04:43.506402 2828 raft_consensus.cc:493] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:43.506541 2828 raft_consensus.cc:515] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.507066 2828 leader_election.cc:290] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194:45285), 41542f7400d44e84b2a8076718d1fe2c (127.29.190.195:39751)
I20251211 21:04:43.508869 2824 raft_consensus.cc:493] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:43.508982 2824 raft_consensus.cc:515] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.509351 2824 leader_election.cc:290] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06f71098455456d8ba52ded14c9008a (127.29.190.193:40497), 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194:45285)
I20251211 21:04:43.509653 2618 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92f2eb9a47f84d8794cee32c3c220ca3" candidate_uuid: "41542f7400d44e84b2a8076718d1fe2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06f71098455456d8ba52ded14c9008a" is_pre_election: true
I20251211 21:04:43.509795 2618 raft_consensus.cc:2468] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41542f7400d44e84b2a8076718d1fe2c in term 0.
I20251211 21:04:43.509649 2694 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92f2eb9a47f84d8794cee32c3c220ca3" candidate_uuid: "41542f7400d44e84b2a8076718d1fe2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67756136aa6d46d0a56bf728de0c1070" is_pre_election: true
I20251211 21:04:43.510032 2694 raft_consensus.cc:2468] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41542f7400d44e84b2a8076718d1fe2c in term 0.
I20251211 21:04:43.510293 2734 leader_election.cc:304] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41542f7400d44e84b2a8076718d1fe2c, b06f71098455456d8ba52ded14c9008a; no voters:
I20251211 21:04:43.510449 2824 raft_consensus.cc:2804] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:43.510491 2824 raft_consensus.cc:493] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:43.510525 2824 raft_consensus.cc:3060] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.511082 2694 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "060a95dd8f794561b938d0d0e5a76ff8" candidate_uuid: "b06f71098455456d8ba52ded14c9008a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67756136aa6d46d0a56bf728de0c1070" is_pre_election: true
I20251211 21:04:43.511119 2769 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "060a95dd8f794561b938d0d0e5a76ff8" candidate_uuid: "b06f71098455456d8ba52ded14c9008a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41542f7400d44e84b2a8076718d1fe2c" is_pre_election: true
I20251211 21:04:43.511184 2694 raft_consensus.cc:2468] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06f71098455456d8ba52ded14c9008a in term 0.
I20251211 21:04:43.511235 2769 raft_consensus.cc:2468] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06f71098455456d8ba52ded14c9008a in term 0.
I20251211 21:04:43.511423 2584 leader_election.cc:304] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67756136aa6d46d0a56bf728de0c1070, b06f71098455456d8ba52ded14c9008a; no voters:
I20251211 21:04:43.511595 2828 raft_consensus.cc:2804] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:43.511677 2828 raft_consensus.cc:493] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:43.511659 2824 raft_consensus.cc:515] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.511726 2828 raft_consensus.cc:3060] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.511971 2824 leader_election.cc:290] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [CANDIDATE]: Term 1 election: Requested vote from peers b06f71098455456d8ba52ded14c9008a (127.29.190.193:40497), 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194:45285)
I20251211 21:04:43.512230 2618 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92f2eb9a47f84d8794cee32c3c220ca3" candidate_uuid: "41542f7400d44e84b2a8076718d1fe2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06f71098455456d8ba52ded14c9008a"
I20251211 21:04:43.512230 2694 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92f2eb9a47f84d8794cee32c3c220ca3" candidate_uuid: "41542f7400d44e84b2a8076718d1fe2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67756136aa6d46d0a56bf728de0c1070"
I20251211 21:04:43.512354 2694 raft_consensus.cc:3060] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.512354 2618 raft_consensus.cc:3060] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.512655 2828 raft_consensus.cc:515] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.512966 2828 leader_election.cc:290] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [CANDIDATE]: Term 1 election: Requested vote from peers 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194:45285), 41542f7400d44e84b2a8076718d1fe2c (127.29.190.195:39751)
I20251211 21:04:43.513209 2694 raft_consensus.cc:2468] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41542f7400d44e84b2a8076718d1fe2c in term 1.
I20251211 21:04:43.513314 2769 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "060a95dd8f794561b938d0d0e5a76ff8" candidate_uuid: "b06f71098455456d8ba52ded14c9008a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41542f7400d44e84b2a8076718d1fe2c"
I20251211 21:04:43.513406 2769 raft_consensus.cc:3060] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.513485 2735 leader_election.cc:304] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41542f7400d44e84b2a8076718d1fe2c, 67756136aa6d46d0a56bf728de0c1070; no voters:
I20251211 21:04:43.513628 2824 raft_consensus.cc:2804] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:43.513628 2694 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "060a95dd8f794561b938d0d0e5a76ff8" candidate_uuid: "b06f71098455456d8ba52ded14c9008a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67756136aa6d46d0a56bf728de0c1070"
I20251211 21:04:43.513713 2824 raft_consensus.cc:697] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Becoming Leader. State: Replica: 41542f7400d44e84b2a8076718d1fe2c, State: Running, Role: LEADER
I20251211 21:04:43.513753 2694 raft_consensus.cc:3060] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:43.513835 2824 consensus_queue.cc:237] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:43.514294 2769 raft_consensus.cc:2468] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06f71098455456d8ba52ded14c9008a in term 1.
I20251211 21:04:43.513209 2618 raft_consensus.cc:2468] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41542f7400d44e84b2a8076718d1fe2c in term 1.
I20251211 21:04:43.514482 2694 raft_consensus.cc:2468] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06f71098455456d8ba52ded14c9008a in term 1.
I20251211 21:04:43.514582 2581 leader_election.cc:304] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41542f7400d44e84b2a8076718d1fe2c, b06f71098455456d8ba52ded14c9008a; no voters:
I20251211 21:04:43.514806 2828 raft_consensus.cc:2804] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:43.514883 2828 raft_consensus.cc:697] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 1 LEADER]: Becoming Leader. State: Replica: b06f71098455456d8ba52ded14c9008a, State: Running, Role: LEADER
I20251211 21:04:43.514976 2828 consensus_queue.cc:237] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:43.515487 2514 catalog_manager.cc:5654] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 41542f7400d44e84b2a8076718d1fe2c (127.29.190.195). New cstate: current_term: 1 leader_uuid: "41542f7400d44e84b2a8076718d1fe2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } health_report { overall_health: HEALTHY } } }
I20251211 21:04:43.516498 2513 catalog_manager.cc:5654] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a reported cstate change: term changed from 0 to 1, leader changed from <none> to b06f71098455456d8ba52ded14c9008a (127.29.190.193). New cstate: current_term: 1 leader_uuid: "b06f71098455456d8ba52ded14c9008a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } health_report { overall_health: HEALTHY } } }
I20251211 21:04:43.529357 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:43.531208 2840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:43.531225 2839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:43.531316 30459 server_base.cc:1047] running on GCE node
W20251211 21:04:43.531282 2842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:43.531687 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:43.531733 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:43.531747 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487083531747 us; error 0 us; skew 500 ppm
I20251211 21:04:43.532616 30459 webserver.cc:492] Webserver started at http://127.29.190.196:41821/ using document root <none> and password file <none>
I20251211 21:04:43.532739 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:43.532780 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:43.532832 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:43.533162 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-3-root/instance:
uuid: "2ed9ffd90a4244fda8a6463ed8213a5e"
format_stamp: "Formatted at 2025-12-11 21:04:43 on dist-test-slave-xjj2"
I20251211 21:04:43.534442 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:04:43.535223 2847 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:43.535427 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:43.535482 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-3-root
uuid: "2ed9ffd90a4244fda8a6463ed8213a5e"
format_stamp: "Formatted at 2025-12-11 21:04:43 on dist-test-slave-xjj2"
I20251211 21:04:43.535544 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:43.559237 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:43.559697 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:43.559981 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:43.560460 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:43.560501 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:43.560544 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:43.560580 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:43.564867 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.196:44909
I20251211 21:04:43.564899 2910 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.196:44909 every 8 connection(s)
I20251211 21:04:43.568970 2911 heartbeater.cc:344] Connected to a master server at 127.29.190.254:44101
I20251211 21:04:43.569067 2911 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:43.569276 2911 heartbeater.cc:507] Master 127.29.190.254:44101 requested a full tablet report, sending...
I20251211 21:04:43.569829 2513 ts_manager.cc:194] Registered new tserver with Master: 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196:44909)
I20251211 21:04:43.570339 2513 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47664
W20251211 21:04:43.588274 2645 tablet.cc:2378] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 21:04:43.595081 2824 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:43.595889 2914 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:43.596028 2824 consensus_queue.cc:1048] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 21:04:43.597046 2824 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20251211 21:04:43.597100 2824 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20251211 21:04:43.602407 2828 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:43.622934 2914 consensus_queue.cc:1048] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:43.623224 2823 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:44.280288 2569 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:44.284591 2769 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "92f2eb9a47f84d8794cee32c3c220ca3"
dest_uuid: "41542f7400d44e84b2a8076718d1fe2c"
mode: GRACEFUL
new_leader_uuid: "67756136aa6d46d0a56bf728de0c1070"
from {username='slave'} at 127.0.0.1:44796
I20251211 21:04:44.284766 2769 raft_consensus.cc:606] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Received request to transfer leadership to TS 67756136aa6d46d0a56bf728de0c1070
I20251211 21:04:44.285094 2569 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251211 21:04:44.285197 2569 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:44.285193 2618 consensus_queue.cc:237] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } }
I20251211 21:04:44.286437 2769 raft_consensus.cc:1275] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Refusing update from remote peer b06f71098455456d8ba52ded14c9008a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:44.286437 2693 raft_consensus.cc:1275] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Refusing update from remote peer b06f71098455456d8ba52ded14c9008a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:44.286826 2931 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:04:44.287015 2823 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:04:44.288825 2769 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } } }
I20251211 21:04:44.288825 2693 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } } }
W20251211 21:04:44.290498 2582 consensus_peers.cc:597] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a -> Peer 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196:44909): Couldn't send request to peer 2ed9ffd90a4244fda8a6463ed8213a5e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 060a95dd8f794561b938d0d0e5a76ff8. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:44.291172 2514 catalog_manager.cc:5654] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c reported cstate change: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "b06f71098455456d8ba52ded14c9008a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } } }
I20251211 21:04:44.361970 2937 ts_tablet_manager.cc:933] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: Initiating tablet copy from peer b06f71098455456d8ba52ded14c9008a (127.29.190.193:40497)
I20251211 21:04:44.362339 2937 tablet_copy_client.cc:323] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.193:40497
I20251211 21:04:44.365594 2628 tablet_copy_service.cc:140] P b06f71098455456d8ba52ded14c9008a: Received BeginTabletCopySession request for tablet 060a95dd8f794561b938d0d0e5a76ff8 from peer 2ed9ffd90a4244fda8a6463ed8213a5e ({username='slave'} at 127.0.0.1:55194)
I20251211 21:04:44.365705 2628 tablet_copy_service.cc:161] P b06f71098455456d8ba52ded14c9008a: Beginning new tablet copy session on tablet 060a95dd8f794561b938d0d0e5a76ff8 from peer 2ed9ffd90a4244fda8a6463ed8213a5e at {username='slave'} at 127.0.0.1:55194: session id = 2ed9ffd90a4244fda8a6463ed8213a5e-060a95dd8f794561b938d0d0e5a76ff8
I20251211 21:04:44.366452 2628 tablet_copy_source_session.cc:215] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:44.367214 2937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060a95dd8f794561b938d0d0e5a76ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:44.367481 2921 raft_consensus.cc:993] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c: : Instructing follower 67756136aa6d46d0a56bf728de0c1070 to start an election
I20251211 21:04:44.367581 2921 raft_consensus.cc:1081] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Signalling peer 67756136aa6d46d0a56bf728de0c1070 to start an election
I20251211 21:04:44.368024 2693 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "92f2eb9a47f84d8794cee32c3c220ca3"
dest_uuid: "67756136aa6d46d0a56bf728de0c1070"
from {username='slave'} at 127.0.0.1:52670
I20251211 21:04:44.368142 2693 raft_consensus.cc:493] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 21:04:44.368201 2693 raft_consensus.cc:3060] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:44.368950 2693 raft_consensus.cc:515] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:44.369241 2937 tablet_copy_client.cc:806] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:44.369382 2937 tablet_copy_client.cc:670] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:44.369450 2693 leader_election.cc:290] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [CANDIDATE]: Term 2 election: Requested vote from peers b06f71098455456d8ba52ded14c9008a (127.29.190.193:40497), 41542f7400d44e84b2a8076718d1fe2c (127.29.190.195:39751)
I20251211 21:04:44.370443 2937 tablet_copy_client.cc:538] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:44.371748 2937 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: Bootstrap starting.
I20251211 21:04:44.373466 2618 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92f2eb9a47f84d8794cee32c3c220ca3" candidate_uuid: "67756136aa6d46d0a56bf728de0c1070" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b06f71098455456d8ba52ded14c9008a"
I20251211 21:04:44.373587 2618 raft_consensus.cc:3060] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:44.374446 2618 raft_consensus.cc:2468] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67756136aa6d46d0a56bf728de0c1070 in term 2.
I20251211 21:04:44.374738 2659 leader_election.cc:304] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67756136aa6d46d0a56bf728de0c1070, b06f71098455456d8ba52ded14c9008a; no voters:
I20251211 21:04:44.374925 2769 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92f2eb9a47f84d8794cee32c3c220ca3" candidate_uuid: "67756136aa6d46d0a56bf728de0c1070" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41542f7400d44e84b2a8076718d1fe2c"
I20251211 21:04:44.374939 2934 raft_consensus.cc:2804] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:04:44.375020 2769 raft_consensus.cc:3055] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Stepping down as leader of term 1
I20251211 21:04:44.375066 2769 raft_consensus.cc:740] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41542f7400d44e84b2a8076718d1fe2c, State: Running, Role: LEADER
I20251211 21:04:44.375147 2934 raft_consensus.cc:697] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 2 LEADER]: Becoming Leader. State: Replica: 67756136aa6d46d0a56bf728de0c1070, State: Running, Role: LEADER
I20251211 21:04:44.375196 2769 consensus_queue.cc:260] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:44.375319 2934 consensus_queue.cc:237] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } }
I20251211 21:04:44.375373 2769 raft_consensus.cc:3060] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:04:44.375830 2937 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 21:04:44.376175 2937 tablet_bootstrap.cc:492] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: Bootstrap complete.
I20251211 21:04:44.376307 2769 raft_consensus.cc:2468] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67756136aa6d46d0a56bf728de0c1070 in term 2.
I20251211 21:04:44.376315 2937 ts_tablet_manager.cc:1403] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251211 21:04:44.376729 2937 raft_consensus.cc:359] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } }
I20251211 21:04:44.376894 2937 raft_consensus.cc:740] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2ed9ffd90a4244fda8a6463ed8213a5e, State: Initialized, Role: LEARNER
I20251211 21:04:44.376981 2937 consensus_queue.cc:260] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } }
I20251211 21:04:44.377300 2937 ts_tablet_manager.cc:1434] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:44.377369 2911 heartbeater.cc:499] Master 127.29.190.254:44101 was elected leader, sending a full tablet report...
I20251211 21:04:44.377744 2628 tablet_copy_service.cc:342] P b06f71098455456d8ba52ded14c9008a: Request end of tablet copy session 2ed9ffd90a4244fda8a6463ed8213a5e-060a95dd8f794561b938d0d0e5a76ff8 received from {username='slave'} at 127.0.0.1:55194
I20251211 21:04:44.377820 2628 tablet_copy_service.cc:434] P b06f71098455456d8ba52ded14c9008a: ending tablet copy session 2ed9ffd90a4244fda8a6463ed8213a5e-060a95dd8f794561b938d0d0e5a76ff8 on tablet 060a95dd8f794561b938d0d0e5a76ff8 with peer 2ed9ffd90a4244fda8a6463ed8213a5e
I20251211 21:04:44.382467 2924 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } } }
I20251211 21:04:44.386912 2513 catalog_manager.cc:5654] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 reported cstate change: term changed from 1 to 2, leader changed from 41542f7400d44e84b2a8076718d1fe2c (127.29.190.195) to 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194). New cstate: current_term: 2 leader_uuid: "67756136aa6d46d0a56bf728de0c1070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:44.388515 2769 consensus_queue.cc:237] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } }
I20251211 21:04:44.389657 2618 raft_consensus.cc:1275] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Refusing update from remote peer 41542f7400d44e84b2a8076718d1fe2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:44.390058 2921 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:04:44.390118 2693 raft_consensus.cc:1275] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Refusing update from remote peer 41542f7400d44e84b2a8076718d1fe2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:04:44.390460 2921 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:04:44.391531 2833 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } } }
I20251211 21:04:44.392210 2693 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } } }
W20251211 21:04:44.393344 2733 consensus_peers.cc:597] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c -> Peer 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196:44909): Couldn't send request to peer 2ed9ffd90a4244fda8a6463ed8213a5e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e08eba0724584cbf99028f322b3ac621. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:44.393828 2512 catalog_manager.cc:5654] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c reported cstate change: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "41542f7400d44e84b2a8076718d1fe2c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:44.393858 2618 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } } }
I20251211 21:04:44.479759 2769 raft_consensus.cc:1275] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 2 FOLLOWER]: Refusing update from remote peer 67756136aa6d46d0a56bf728de0c1070: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:04:44.480124 2934 consensus_queue.cc:1048] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:04:44.481096 2618 raft_consensus.cc:1275] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 2 FOLLOWER]: Refusing update from remote peer 67756136aa6d46d0a56bf728de0c1070: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:04:44.481407 2943 consensus_queue.cc:1048] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:04:44.484534 2937 ts_tablet_manager.cc:933] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: Initiating tablet copy from peer 41542f7400d44e84b2a8076718d1fe2c (127.29.190.195:39751)
I20251211 21:04:44.484817 2937 tablet_copy_client.cc:323] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:39751
I20251211 21:04:44.485854 2885 raft_consensus.cc:1217] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251211 21:04:44.486033 2885 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } } }
I20251211 21:04:44.488773 2779 tablet_copy_service.cc:140] P 41542f7400d44e84b2a8076718d1fe2c: Received BeginTabletCopySession request for tablet e08eba0724584cbf99028f322b3ac621 from peer 2ed9ffd90a4244fda8a6463ed8213a5e ({username='slave'} at 127.0.0.1:44812)
I20251211 21:04:44.488863 2779 tablet_copy_service.cc:161] P 41542f7400d44e84b2a8076718d1fe2c: Beginning new tablet copy session on tablet e08eba0724584cbf99028f322b3ac621 from peer 2ed9ffd90a4244fda8a6463ed8213a5e at {username='slave'} at 127.0.0.1:44812: session id = 2ed9ffd90a4244fda8a6463ed8213a5e-e08eba0724584cbf99028f322b3ac621
I20251211 21:04:44.489573 2779 tablet_copy_source_session.cc:215] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:04:44.490366 2937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08eba0724584cbf99028f322b3ac621. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:44.492252 2937 tablet_copy_client.cc:806] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: tablet copy: Starting download of 0 data blocks...
I20251211 21:04:44.492398 2937 tablet_copy_client.cc:670] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: tablet copy: Starting download of 1 WAL segments...
I20251211 21:04:44.493678 2937 tablet_copy_client.cc:538] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:04:44.494937 2937 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: Bootstrap starting.
I20251211 21:04:44.498467 2937 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:04:44.498729 2937 tablet_bootstrap.cc:492] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: Bootstrap complete.
I20251211 21:04:44.498890 2937 ts_tablet_manager.cc:1403] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20251211 21:04:44.499330 2937 raft_consensus.cc:359] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } }
I20251211 21:04:44.499457 2937 raft_consensus.cc:740] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2ed9ffd90a4244fda8a6463ed8213a5e, State: Initialized, Role: LEARNER
I20251211 21:04:44.499558 2937 consensus_queue.cc:260] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: true } }
I20251211 21:04:44.499867 2937 ts_tablet_manager.cc:1434] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:04:44.500238 2779 tablet_copy_service.cc:342] P 41542f7400d44e84b2a8076718d1fe2c: Request end of tablet copy session 2ed9ffd90a4244fda8a6463ed8213a5e-e08eba0724584cbf99028f322b3ac621 received from {username='slave'} at 127.0.0.1:44812
I20251211 21:04:44.500314 2779 tablet_copy_service.cc:434] P 41542f7400d44e84b2a8076718d1fe2c: ending tablet copy session 2ed9ffd90a4244fda8a6463ed8213a5e-e08eba0724584cbf99028f322b3ac621 on tablet e08eba0724584cbf99028f322b3ac621 with peer 2ed9ffd90a4244fda8a6463ed8213a5e
I20251211 21:04:44.574337 2885 raft_consensus.cc:1217] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251211 21:04:44.671648 2924 raft_consensus.cc:1064] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: attempting to promote NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e to VOTER
I20251211 21:04:44.672107 2924 consensus_queue.cc:237] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } }
I20251211 21:04:44.673511 2693 raft_consensus.cc:1275] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Refusing update from remote peer b06f71098455456d8ba52ded14c9008a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:04:44.673527 2768 raft_consensus.cc:1275] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Refusing update from remote peer b06f71098455456d8ba52ded14c9008a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:04:44.673887 2885 raft_consensus.cc:1275] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 LEARNER]: Refusing update from remote peer b06f71098455456d8ba52ded14c9008a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:04:44.673931 2945 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:04:44.674249 2945 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:04:44.674710 2924 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:04:44.676477 2885 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.676424 2693 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.678649 2515 catalog_manager.cc:5654] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 reported cstate change: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b06f71098455456d8ba52ded14c9008a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.689178 2833 raft_consensus.cc:1064] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c: attempting to promote NON_VOTER 2ed9ffd90a4244fda8a6463ed8213a5e to VOTER
I20251211 21:04:44.689626 2833 consensus_queue.cc:237] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } }
I20251211 21:04:44.690809 2885 raft_consensus.cc:1275] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 LEARNER]: Refusing update from remote peer 41542f7400d44e84b2a8076718d1fe2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:04:44.690904 2693 raft_consensus.cc:1275] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Refusing update from remote peer 41542f7400d44e84b2a8076718d1fe2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:04:44.690904 2618 raft_consensus.cc:1275] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Refusing update from remote peer 41542f7400d44e84b2a8076718d1fe2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:04:44.691308 2956 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:04:44.691519 2833 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:04:44.691689 2921 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:04:44.693542 2693 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.693596 2885 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.694191 2956 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.696149 2618 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.696527 2514 catalog_manager.cc:5654] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c reported cstate change: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "41542f7400d44e84b2a8076718d1fe2c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:04:44.708271 2931 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.710074 2768 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2ed9ffd90a4244fda8a6463ed8213a5e (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } attrs { replace: true } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.757834 2768 consensus_queue.cc:237] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } }
I20251211 21:04:44.758886 2618 consensus_queue.cc:237] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } }
I20251211 21:04:44.759195 2885 raft_consensus.cc:1275] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Refusing update from remote peer 41542f7400d44e84b2a8076718d1fe2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:04:44.759575 2956 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:04:44.760221 2693 raft_consensus.cc:1275] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Refusing update from remote peer 41542f7400d44e84b2a8076718d1fe2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:04:44.760244 2885 raft_consensus.cc:1275] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Refusing update from remote peer b06f71098455456d8ba52ded14c9008a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:04:44.760612 2959 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:04:44.760730 2768 raft_consensus.cc:1275] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Refusing update from remote peer b06f71098455456d8ba52ded14c9008a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:04:44.761150 2931 consensus_queue.cc:1048] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:04:44.761284 2956 consensus_queue.cc:1048] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:04:44.762113 2884 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b06f71098455456d8ba52ded14c9008a (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.763388 2885 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.764976 2768 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.765100 2693 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b06f71098455456d8ba52ded14c9008a (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.766464 2515 catalog_manager.cc:5654] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e reported cstate change: config changed from index 3 to 4, VOTER b06f71098455456d8ba52ded14c9008a (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "41542f7400d44e84b2a8076718d1fe2c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.767840 2513 catalog_manager.cc:5654] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c reported cstate change: config changed from index 3 to 4, VOTER 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194) evicted. New cstate: current_term: 1 leader_uuid: "b06f71098455456d8ba52ded14c9008a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.811028 2606 tablet_service.cc:1552] Processing DeleteTablet for tablet e08eba0724584cbf99028f322b3ac621 with delete_type TABLET_DATA_TOMBSTONED (TS b06f71098455456d8ba52ded14c9008a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55152
I20251211 21:04:44.812008 2960 tablet_replica.cc:333] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: stopping tablet replica
I20251211 21:04:44.812171 2960 raft_consensus.cc:2243] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:44.812311 2960 raft_consensus.cc:2272] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:44.812533 2921 raft_consensus.cc:2955] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b06f71098455456d8ba52ded14c9008a (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67756136aa6d46d0a56bf728de0c1070" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 45285 } } peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.813064 2960 ts_tablet_manager.cc:1916] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:44.814196 2499 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet e08eba0724584cbf99028f322b3ac621 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:44.814941 2960 ts_tablet_manager.cc:1929] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251211 21:04:44.815003 2960 log.cc:1199] T e08eba0724584cbf99028f322b3ac621 P b06f71098455456d8ba52ded14c9008a: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/e08eba0724584cbf99028f322b3ac621
I20251211 21:04:44.815490 2501 catalog_manager.cc:4985] TS b06f71098455456d8ba52ded14c9008a (127.29.190.193:40497): tablet e08eba0724584cbf99028f322b3ac621 (table test-workload [id=270d18714cb4490a82a0d7ba058c97a1]) successfully deleted
I20251211 21:04:44.895223 2684 tablet_service.cc:1552] Processing DeleteTablet for tablet 060a95dd8f794561b938d0d0e5a76ff8 with delete_type TABLET_DATA_TOMBSTONED (TS 67756136aa6d46d0a56bf728de0c1070 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52664
I20251211 21:04:44.895756 2961 tablet_replica.cc:333] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: stopping tablet replica
I20251211 21:04:44.895893 2961 raft_consensus.cc:2243] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:44.896039 2961 raft_consensus.cc:2272] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:44.896632 2961 ts_tablet_manager.cc:1916] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:04:44.898690 2961 ts_tablet_manager.cc:1929] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251211 21:04:44.898757 2961 log.cc:1199] T 060a95dd8f794561b938d0d0e5a76ff8 P 67756136aa6d46d0a56bf728de0c1070: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/060a95dd8f794561b938d0d0e5a76ff8
I20251211 21:04:44.899174 2502 catalog_manager.cc:4985] TS 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194:45285): tablet 060a95dd8f794561b938d0d0e5a76ff8 (table test-workload [id=270d18714cb4490a82a0d7ba058c97a1]) successfully deleted
I20251211 21:04:44.956444 2823 raft_consensus.cc:2955] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67756136aa6d46d0a56bf728de0c1070 (127.29.190.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "41542f7400d44e84b2a8076718d1fe2c" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 39751 } } peers { permanent_uuid: "b06f71098455456d8ba52ded14c9008a" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 40497 } } peers { permanent_uuid: "2ed9ffd90a4244fda8a6463ed8213a5e" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 44909 } attrs { promote: false } } }
I20251211 21:04:44.957960 2501 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 060a95dd8f794561b938d0d0e5a76ff8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:04:46.285555 2569 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:46.286116 2569 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:46.286198 2569 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:48.286449 2569 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:48.286942 2569 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:48.287025 2569 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:50.287367 2569 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:50.287901 2569 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:50.287987 2569 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:52.288300 2569 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:52.288765 2569 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:52.288842 2569 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:52.620993 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:04:52.625069 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:52.625279 30459 tablet_replica.cc:333] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a: stopping tablet replica
I20251211 21:04:52.625396 30459 raft_consensus.cc:2243] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:52.625494 30459 raft_consensus.cc:2272] T 92f2eb9a47f84d8794cee32c3c220ca3 P b06f71098455456d8ba52ded14c9008a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.625890 30459 tablet_replica.cc:333] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a: stopping tablet replica
I20251211 21:04:52.625959 30459 raft_consensus.cc:2243] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:04:52.626099 30459 raft_consensus.cc:2272] T 060a95dd8f794561b938d0d0e5a76ff8 P b06f71098455456d8ba52ded14c9008a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.639195 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:04:52.641512 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:04:52.645782 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:52.645995 30459 tablet_replica.cc:333] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070: stopping tablet replica
I20251211 21:04:52.646099 30459 raft_consensus.cc:2243] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:52.646227 30459 raft_consensus.cc:2272] T e08eba0724584cbf99028f322b3ac621 P 67756136aa6d46d0a56bf728de0c1070 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.646654 30459 tablet_replica.cc:333] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070: stopping tablet replica
I20251211 21:04:52.646728 30459 raft_consensus.cc:2243] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:04:52.646875 30459 raft_consensus.cc:2272] T 92f2eb9a47f84d8794cee32c3c220ca3 P 67756136aa6d46d0a56bf728de0c1070 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.659737 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:04:52.662258 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:04:52.666261 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:52.666531 30459 tablet_replica.cc:333] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c: stopping tablet replica
I20251211 21:04:52.666678 30459 raft_consensus.cc:2243] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:52.666847 30459 raft_consensus.cc:2272] T 060a95dd8f794561b938d0d0e5a76ff8 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.667357 30459 tablet_replica.cc:333] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c: stopping tablet replica
I20251211 21:04:52.667466 30459 raft_consensus.cc:2243] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:04:52.667742 30459 raft_consensus.cc:2272] T e08eba0724584cbf99028f322b3ac621 P 41542f7400d44e84b2a8076718d1fe2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.668161 30459 tablet_replica.cc:333] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c: stopping tablet replica
I20251211 21:04:52.668326 30459 raft_consensus.cc:2243] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:52.668454 30459 raft_consensus.cc:2272] T 92f2eb9a47f84d8794cee32c3c220ca3 P 41542f7400d44e84b2a8076718d1fe2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.681334 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:04:52.683566 30459 tablet_server.cc:178] TabletServer@127.29.190.196:0 shutting down...
I20251211 21:04:52.687129 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:52.687338 30459 tablet_replica.cc:333] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e: stopping tablet replica
I20251211 21:04:52.687458 30459 raft_consensus.cc:2243] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:52.687585 30459 raft_consensus.cc:2272] T e08eba0724584cbf99028f322b3ac621 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.688036 30459 tablet_replica.cc:333] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e: stopping tablet replica
I20251211 21:04:52.688110 30459 raft_consensus.cc:2243] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:52.688210 30459 raft_consensus.cc:2272] T 060a95dd8f794561b938d0d0e5a76ff8 P 2ed9ffd90a4244fda8a6463ed8213a5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.701432 30459 tablet_server.cc:195] TabletServer@127.29.190.196:0 shutdown complete.
I20251211 21:04:52.703634 30459 master.cc:561] Master@127.29.190.254:44101 shutting down...
I20251211 21:04:52.707096 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:04:52.707267 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:52.707332 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4b985690ce5044b098174c92b7e522da: stopping tablet replica
I20251211 21:04:52.719980 30459 master.cc:583] Master@127.29.190.254:44101 shutdown complete.
[ OK ] AutoRebalancerTest.AutoRebalancingUnstableCluster (10491 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor
I20251211 21:04:52.727236 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:45687
I20251211 21:04:52.727627 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:52.729410 2971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:52.729601 2968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:52.729635 2969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:52.729656 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:52.729899 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:52.729939 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:52.729959 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487092729958 us; error 0 us; skew 500 ppm
I20251211 21:04:52.730773 30459 webserver.cc:492] Webserver started at http://127.29.190.254:37043/ using document root <none> and password file <none>
I20251211 21:04:52.730908 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:52.730957 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:52.731030 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:52.731396 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "872a0eab3b894965a6b7ad54cb4504eb"
format_stamp: "Formatted at 2025-12-11 21:04:52 on dist-test-slave-xjj2"
I20251211 21:04:52.732815 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:04:52.733657 2976 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.733901 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:52.733963 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "872a0eab3b894965a6b7ad54cb4504eb"
format_stamp: "Formatted at 2025-12-11 21:04:52 on dist-test-slave-xjj2"
I20251211 21:04:52.734018 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:52.744704 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:52.745059 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:52.748858 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:45687
I20251211 21:04:52.752357 3028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:45687 every 8 connection(s)
I20251211 21:04:52.752789 3029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:52.754592 3029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb: Bootstrap starting.
I20251211 21:04:52.755352 3029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:52.756413 3029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb: No bootstrap required, opened a new log
I20251211 21:04:52.756768 3029 raft_consensus.cc:359] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872a0eab3b894965a6b7ad54cb4504eb" member_type: VOTER }
I20251211 21:04:52.756853 3029 raft_consensus.cc:385] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:52.756875 3029 raft_consensus.cc:740] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 872a0eab3b894965a6b7ad54cb4504eb, State: Initialized, Role: FOLLOWER
I20251211 21:04:52.756978 3029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872a0eab3b894965a6b7ad54cb4504eb" member_type: VOTER }
I20251211 21:04:52.757057 3029 raft_consensus.cc:399] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:04:52.757081 3029 raft_consensus.cc:493] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:04:52.757109 3029 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:52.757778 3029 raft_consensus.cc:515] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872a0eab3b894965a6b7ad54cb4504eb" member_type: VOTER }
I20251211 21:04:52.757887 3029 leader_election.cc:304] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 872a0eab3b894965a6b7ad54cb4504eb; no voters:
I20251211 21:04:52.758042 3029 leader_election.cc:290] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:04:52.758162 3032 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:52.758360 3032 raft_consensus.cc:697] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 1 LEADER]: Becoming Leader. State: Replica: 872a0eab3b894965a6b7ad54cb4504eb, State: Running, Role: LEADER
I20251211 21:04:52.758455 3029 sys_catalog.cc:565] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:04:52.758512 3032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872a0eab3b894965a6b7ad54cb4504eb" member_type: VOTER }
I20251211 21:04:52.758924 3034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 872a0eab3b894965a6b7ad54cb4504eb. Latest consensus state: current_term: 1 leader_uuid: "872a0eab3b894965a6b7ad54cb4504eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872a0eab3b894965a6b7ad54cb4504eb" member_type: VOTER } }
I20251211 21:04:52.758914 3033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "872a0eab3b894965a6b7ad54cb4504eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872a0eab3b894965a6b7ad54cb4504eb" member_type: VOTER } }
I20251211 21:04:52.759017 3034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [sys.catalog]: This master's current role is: LEADER
I20251211 21:04:52.759025 3033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [sys.catalog]: This master's current role is: LEADER
I20251211 21:04:52.759265 3038 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:04:52.760118 3038 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:04:52.760279 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:04:52.762657 3038 catalog_manager.cc:1357] Generated new cluster ID: 565f773e48034649ac60ab5b5019e1d9
I20251211 21:04:52.762719 3038 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:04:52.780615 3038 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:04:52.781214 3038 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:04:52.786989 3038 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb: Generated new TSK 0
I20251211 21:04:52.787164 3038 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:04:52.792595 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:52.794399 3051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:52.794415 3053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:52.794526 3050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:52.794552 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:52.794797 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:52.794831 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:52.794844 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487092794844 us; error 0 us; skew 500 ppm
I20251211 21:04:52.795765 30459 webserver.cc:492] Webserver started at http://127.29.190.193:44829/ using document root <none> and password file <none>
I20251211 21:04:52.795904 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:52.795953 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:52.796012 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:52.796447 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "d4ee5becbf2249afa11c543acc4bc53b"
format_stamp: "Formatted at 2025-12-11 21:04:52 on dist-test-slave-xjj2"
I20251211 21:04:52.797917 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:04:52.798816 3058 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.799098 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:52.799178 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "d4ee5becbf2249afa11c543acc4bc53b"
format_stamp: "Formatted at 2025-12-11 21:04:52 on dist-test-slave-xjj2"
I20251211 21:04:52.799255 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:52.819438 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:52.819912 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:52.820240 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:52.820749 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:52.820793 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.820840 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:52.820873 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.825205 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:45881
I20251211 21:04:52.825225 3121 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:45881 every 8 connection(s)
I20251211 21:04:52.826079 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:52.827848 3126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:52.827893 3127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:52.828203 3129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:52.828269 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:52.828572 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:52.828624 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:52.828644 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487092828643 us; error 0 us; skew 500 ppm
I20251211 21:04:52.829566 30459 webserver.cc:492] Webserver started at http://127.29.190.194:38635/ using document root <none> and password file <none>
I20251211 21:04:52.829730 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:52.829792 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:52.829861 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:52.830368 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd"
format_stamp: "Formatted at 2025-12-11 21:04:52 on dist-test-slave-xjj2"
I20251211 21:04:52.830806 3122 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45687
I20251211 21:04:52.830904 3122 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:52.831138 3122 heartbeater.cc:507] Master 127.29.190.254:45687 requested a full tablet report, sending...
I20251211 21:04:52.831866 2993 ts_manager.cc:194] Registered new tserver with Master: d4ee5becbf2249afa11c543acc4bc53b (127.29.190.193:45881)
I20251211 21:04:52.832129 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:52.832823 2993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36208
I20251211 21:04:52.833329 3134 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.833628 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:52.833688 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd"
format_stamp: "Formatted at 2025-12-11 21:04:52 on dist-test-slave-xjj2"
I20251211 21:04:52.833760 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:52.869962 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:52.870359 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:52.870673 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:52.871158 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:52.871197 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.871228 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:52.871243 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.876588 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:41105
I20251211 21:04:52.876627 3197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:41105 every 8 connection(s)
I20251211 21:04:52.877435 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:04:52.879184 3201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:52.879313 3204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:04:52.879400 3202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:04:52.879751 30459 server_base.cc:1047] running on GCE node
I20251211 21:04:52.879920 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:04:52.879956 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:04:52.879977 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487092879977 us; error 0 us; skew 500 ppm
I20251211 21:04:52.881044 30459 webserver.cc:492] Webserver started at http://127.29.190.195:36221/ using document root <none> and password file <none>
I20251211 21:04:52.881229 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:04:52.881291 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:04:52.881366 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:04:52.881460 3198 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45687
I20251211 21:04:52.881565 3198 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:52.881780 3198 heartbeater.cc:507] Master 127.29.190.254:45687 requested a full tablet report, sending...
I20251211 21:04:52.881776 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "745f231af43b462ba4679d1dabadb199"
format_stamp: "Formatted at 2025-12-11 21:04:52 on dist-test-slave-xjj2"
I20251211 21:04:52.882403 2993 ts_manager.cc:194] Registered new tserver with Master: 26b3d2b2447a40f0b12bb6aa02ecc7fd (127.29.190.194:41105)
I20251211 21:04:52.882912 2993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40184
I20251211 21:04:52.883291 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:52.884234 3209 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.884493 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251211 21:04:52.884553 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "745f231af43b462ba4679d1dabadb199"
format_stamp: "Formatted at 2025-12-11 21:04:52 on dist-test-slave-xjj2"
I20251211 21:04:52.884610 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:04:52.895020 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:04:52.895406 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:04:52.895709 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:04:52.896190 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:04:52.896230 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.896263 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:04:52.896291 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:04:52.900672 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:37743
I20251211 21:04:52.900723 3272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:37743 every 8 connection(s)
I20251211 21:04:52.904948 3273 heartbeater.cc:344] Connected to a master server at 127.29.190.254:45687
I20251211 21:04:52.905057 3273 heartbeater.cc:461] Registering TS with master...
I20251211 21:04:52.905277 3273 heartbeater.cc:507] Master 127.29.190.254:45687 requested a full tablet report, sending...
I20251211 21:04:52.905855 2993 ts_manager.cc:194] Registered new tserver with Master: 745f231af43b462ba4679d1dabadb199 (127.29.190.195:37743)
I20251211 21:04:52.906358 2993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40196
I20251211 21:04:52.906687 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005644423s
I20251211 21:04:53.833848 3122 heartbeater.cc:499] Master 127.29.190.254:45687 was elected leader, sending a full tablet report...
I20251211 21:04:53.883822 3198 heartbeater.cc:499] Master 127.29.190.254:45687 was elected leader, sending a full tablet report...
I20251211 21:04:53.907187 3273 heartbeater.cc:499] Master 127.29.190.254:45687 was elected leader, sending a full tablet report...
I20251211 21:04:53.932993 30459 test_util.cc:276] Using random seed: 2132206526
I20251211 21:04:53.941448 2993 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40198:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:04:53.941885 2993 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:04:53.951351 3162 tablet_service.cc:1505] Processing CreateTablet for tablet c25188b900fb4fcba7e2d8cace2f42e8 (DEFAULT_TABLE table=test-workload [id=234715f71f0042b5b921fbf1df10bc2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:04:53.951736 3162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25188b900fb4fcba7e2d8cace2f42e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:53.951740 3086 tablet_service.cc:1505] Processing CreateTablet for tablet c25188b900fb4fcba7e2d8cace2f42e8 (DEFAULT_TABLE table=test-workload [id=234715f71f0042b5b921fbf1df10bc2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:04:53.952091 3086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25188b900fb4fcba7e2d8cace2f42e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:53.952232 3237 tablet_service.cc:1505] Processing CreateTablet for tablet c25188b900fb4fcba7e2d8cace2f42e8 (DEFAULT_TABLE table=test-workload [id=234715f71f0042b5b921fbf1df10bc2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 21:04:53.952445 3237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25188b900fb4fcba7e2d8cace2f42e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:04:53.953790 3293 tablet_bootstrap.cc:492] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd: Bootstrap starting.
I20251211 21:04:53.954345 3294 tablet_bootstrap.cc:492] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b: Bootstrap starting.
I20251211 21:04:53.954952 3293 tablet_bootstrap.cc:654] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:53.955273 3294 tablet_bootstrap.cc:654] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:53.955783 3295 tablet_bootstrap.cc:492] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199: Bootstrap starting.
I20251211 21:04:53.956110 3293 tablet_bootstrap.cc:492] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd: No bootstrap required, opened a new log
I20251211 21:04:53.956184 3293 ts_tablet_manager.cc:1403] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:04:53.956560 3293 raft_consensus.cc:359] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:53.956653 3293 raft_consensus.cc:385] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:53.956676 3293 raft_consensus.cc:740] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b3d2b2447a40f0b12bb6aa02ecc7fd, State: Initialized, Role: FOLLOWER
I20251211 21:04:53.956722 3295 tablet_bootstrap.cc:654] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199: Neither blocks nor log segments found. Creating new log.
I20251211 21:04:53.956782 3293 consensus_queue.cc:260] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:53.957114 3293 ts_tablet_manager.cc:1434] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:53.957810 3294 tablet_bootstrap.cc:492] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b: No bootstrap required, opened a new log
I20251211 21:04:53.957909 3294 ts_tablet_manager.cc:1403] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251211 21:04:53.958434 3294 raft_consensus.cc:359] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:53.958556 3294 raft_consensus.cc:385] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:53.958600 3294 raft_consensus.cc:740] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4ee5becbf2249afa11c543acc4bc53b, State: Initialized, Role: FOLLOWER
I20251211 21:04:53.958726 3294 consensus_queue.cc:260] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:53.959067 3294 ts_tablet_manager.cc:1434] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:53.959594 3295 tablet_bootstrap.cc:492] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199: No bootstrap required, opened a new log
I20251211 21:04:53.959743 3295 ts_tablet_manager.cc:1403] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:04:53.960193 3295 raft_consensus.cc:359] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:53.960299 3295 raft_consensus.cc:385] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:04:53.960343 3295 raft_consensus.cc:740] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 745f231af43b462ba4679d1dabadb199, State: Initialized, Role: FOLLOWER
I20251211 21:04:53.960472 3295 consensus_queue.cc:260] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:53.960769 3295 ts_tablet_manager.cc:1434] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:04:54.115568 3301 raft_consensus.cc:493] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:04:54.115764 3301 raft_consensus.cc:515] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:54.116263 3301 leader_election.cc:290] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b3d2b2447a40f0b12bb6aa02ecc7fd (127.29.190.194:41105), d4ee5becbf2249afa11c543acc4bc53b (127.29.190.193:45881)
I20251211 21:04:54.119937 3096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c25188b900fb4fcba7e2d8cace2f42e8" candidate_uuid: "745f231af43b462ba4679d1dabadb199" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ee5becbf2249afa11c543acc4bc53b" is_pre_election: true
I20251211 21:04:54.119940 3172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c25188b900fb4fcba7e2d8cace2f42e8" candidate_uuid: "745f231af43b462ba4679d1dabadb199" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" is_pre_election: true
I20251211 21:04:54.120112 3096 raft_consensus.cc:2468] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 745f231af43b462ba4679d1dabadb199 in term 0.
I20251211 21:04:54.120128 3172 raft_consensus.cc:2468] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 745f231af43b462ba4679d1dabadb199 in term 0.
I20251211 21:04:54.120415 3210 leader_election.cc:304] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b3d2b2447a40f0b12bb6aa02ecc7fd, 745f231af43b462ba4679d1dabadb199; no voters:
I20251211 21:04:54.120595 3301 raft_consensus.cc:2804] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:04:54.120649 3301 raft_consensus.cc:493] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:04:54.120678 3301 raft_consensus.cc:3060] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:54.121585 3301 raft_consensus.cc:515] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:54.121934 3301 leader_election.cc:290] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [CANDIDATE]: Term 1 election: Requested vote from peers 26b3d2b2447a40f0b12bb6aa02ecc7fd (127.29.190.194:41105), d4ee5becbf2249afa11c543acc4bc53b (127.29.190.193:45881)
I20251211 21:04:54.122308 3172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c25188b900fb4fcba7e2d8cace2f42e8" candidate_uuid: "745f231af43b462ba4679d1dabadb199" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd"
I20251211 21:04:54.122407 3172 raft_consensus.cc:3060] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:54.122375 3096 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c25188b900fb4fcba7e2d8cace2f42e8" candidate_uuid: "745f231af43b462ba4679d1dabadb199" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ee5becbf2249afa11c543acc4bc53b"
I20251211 21:04:54.122490 3096 raft_consensus.cc:3060] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:04:54.123294 3172 raft_consensus.cc:2468] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 745f231af43b462ba4679d1dabadb199 in term 1.
I20251211 21:04:54.123365 3096 raft_consensus.cc:2468] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 745f231af43b462ba4679d1dabadb199 in term 1.
I20251211 21:04:54.123544 3210 leader_election.cc:304] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b3d2b2447a40f0b12bb6aa02ecc7fd, 745f231af43b462ba4679d1dabadb199; no voters:
I20251211 21:04:54.123715 3301 raft_consensus.cc:2804] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:04:54.123912 3301 raft_consensus.cc:697] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 1 LEADER]: Becoming Leader. State: Replica: 745f231af43b462ba4679d1dabadb199, State: Running, Role: LEADER
I20251211 21:04:54.124051 3301 consensus_queue.cc:237] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } }
I20251211 21:04:54.125583 2993 catalog_manager.cc:5654] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 reported cstate change: term changed from 0 to 1, leader changed from <none> to 745f231af43b462ba4679d1dabadb199 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "745f231af43b462ba4679d1dabadb199" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "745f231af43b462ba4679d1dabadb199" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 37743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4ee5becbf2249afa11c543acc4bc53b" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 45881 } health_report { overall_health: UNKNOWN } } }
I20251211 21:04:54.136972 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:04:54.140487 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:04:54.140762 30459 tablet_replica.cc:333] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b: stopping tablet replica
I20251211 21:04:54.140897 30459 raft_consensus.cc:2243] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:04:54.141023 30459 raft_consensus.cc:2272] T c25188b900fb4fcba7e2d8cace2f42e8 P d4ee5becbf2249afa11c543acc4bc53b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:04:54.153707 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
W20251211 21:04:54.645635 3210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.193:45881: connect: Connection refused (error 111)
W20251211 21:04:54.646445 3210 consensus_peers.cc:597] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 -> Peer d4ee5becbf2249afa11c543acc4bc53b (127.29.190.193:45881): Couldn't send request to peer d4ee5becbf2249afa11c543acc4bc53b. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:45881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:04:54.723328 3306 consensus_queue.cc:1048] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b3d2b2447a40f0b12bb6aa02ecc7fd" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:04:54.760373 3047 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:54.760675 3047 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:54.760752 3047 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:04:56.761061 3047 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:56.761368 3047 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:56.761425 3047 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251211 21:04:56.979221 3210 consensus_peers.cc:597] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 -> Peer d4ee5becbf2249afa11c543acc4bc53b (127.29.190.193:45881): Couldn't send request to peer d4ee5becbf2249afa11c543acc4bc53b. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:45881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251211 21:04:58.761716 3047 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:04:58.762006 3047 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:04:58.762054 3047 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251211 21:04:59.767516 3210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.193:45881: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20251211 21:04:59.768301 3210 consensus_peers.cc:597] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 -> Peer d4ee5becbf2249afa11c543acc4bc53b (127.29.190.193:45881): Couldn't send request to peer d4ee5becbf2249afa11c543acc4bc53b. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:45881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20251211 21:05:00.762393 3047 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:05:00.762681 3047 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:05:00.762734 3047 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251211 21:05:02.322290 3210 consensus_peers.cc:597] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 -> Peer d4ee5becbf2249afa11c543acc4bc53b (127.29.190.193:45881): Couldn't send request to peer d4ee5becbf2249afa11c543acc4bc53b. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:45881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251211 21:05:02.763092 3047 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:05:02.763377 3047 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:05:02.763428 3047 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251211 21:05:04.622282 3210 consensus_peers.cc:597] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 -> Peer d4ee5becbf2249afa11c543acc4bc53b (127.29.190.193:45881): Couldn't send request to peer d4ee5becbf2249afa11c543acc4bc53b. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:45881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20251211 21:05:04.763727 3047 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251211 21:05:04.764010 3047 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251211 21:05:04.764066 3047 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251211 21:05:05.212957 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:05:05.216483 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:05.216701 30459 tablet_replica.cc:333] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd: stopping tablet replica
I20251211 21:05:05.216820 30459 raft_consensus.cc:2243] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:05.216930 30459 raft_consensus.cc:2272] T c25188b900fb4fcba7e2d8cace2f42e8 P 26b3d2b2447a40f0b12bb6aa02ecc7fd [term 1 FOLLOWER]: Raft consensus is shut down!
W20251211 21:05:05.222136 3210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.193:45881: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20251211 21:05:05.229569 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:05:05.231686 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:05:05.235512 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:05.235738 30459 tablet_replica.cc:333] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199: stopping tablet replica
I20251211 21:05:05.235867 30459 raft_consensus.cc:2243] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:05.236085 30459 raft_consensus.cc:2272] T c25188b900fb4fcba7e2d8cace2f42e8 P 745f231af43b462ba4679d1dabadb199 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:05.249441 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:05:05.251386 30459 master.cc:561] Master@127.29.190.254:45687 shutting down...
I20251211 21:05:05.254659 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:05.254817 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:05.254866 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 872a0eab3b894965a6b7ad54cb4504eb: stopping tablet replica
I20251211 21:05:05.268056 30459 master.cc:583] Master@127.29.190.254:45687 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor (12546 ms)
[ RUN ] AutoRebalancerTest.NoRebalancingIfReplicasRecovering
I20251211 21:05:05.274051 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:34521
I20251211 21:05:05.274389 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:05.275899 3343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:05.275909 3344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:05.275998 3346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:05.276192 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:05.276362 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:05.276400 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:05.276415 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487105276415 us; error 0 us; skew 500 ppm
I20251211 21:05:05.277159 30459 webserver.cc:492] Webserver started at http://127.29.190.254:43707/ using document root <none> and password file <none>
I20251211 21:05:05.277280 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:05.277328 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:05.277384 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:05.277716 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "4148f597544440588a5a7fc54d1ca549"
format_stamp: "Formatted at 2025-12-11 21:05:05 on dist-test-slave-xjj2"
I20251211 21:05:05.279011 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:05.279932 3351 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.280187 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:05.280252 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "4148f597544440588a5a7fc54d1ca549"
format_stamp: "Formatted at 2025-12-11 21:05:05 on dist-test-slave-xjj2"
I20251211 21:05:05.280323 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:05.289146 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:05.289535 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:05.293407 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:34521
I20251211 21:05:05.295467 3403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:34521 every 8 connection(s)
I20251211 21:05:05.295948 3404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:05.297785 3404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549: Bootstrap starting.
I20251211 21:05:05.298578 3404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:05.299546 3404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549: No bootstrap required, opened a new log
I20251211 21:05:05.299971 3404 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4148f597544440588a5a7fc54d1ca549" member_type: VOTER }
I20251211 21:05:05.300091 3404 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:05.300134 3404 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4148f597544440588a5a7fc54d1ca549, State: Initialized, Role: FOLLOWER
I20251211 21:05:05.300266 3404 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4148f597544440588a5a7fc54d1ca549" member_type: VOTER }
I20251211 21:05:05.300347 3404 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:05:05.300386 3404 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:05:05.300433 3404 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:05.301115 3404 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4148f597544440588a5a7fc54d1ca549" member_type: VOTER }
I20251211 21:05:05.301234 3404 leader_election.cc:304] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4148f597544440588a5a7fc54d1ca549; no voters:
I20251211 21:05:05.301403 3404 leader_election.cc:290] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:05:05.301529 3407 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:05.301726 3407 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 1 LEADER]: Becoming Leader. State: Replica: 4148f597544440588a5a7fc54d1ca549, State: Running, Role: LEADER
I20251211 21:05:05.301838 3404 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:05:05.301877 3407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4148f597544440588a5a7fc54d1ca549" member_type: VOTER }
I20251211 21:05:05.302304 3408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4148f597544440588a5a7fc54d1ca549" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4148f597544440588a5a7fc54d1ca549" member_type: VOTER } }
I20251211 21:05:05.302330 3409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4148f597544440588a5a7fc54d1ca549. Latest consensus state: current_term: 1 leader_uuid: "4148f597544440588a5a7fc54d1ca549" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4148f597544440588a5a7fc54d1ca549" member_type: VOTER } }
I20251211 21:05:05.302471 3409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [sys.catalog]: This master's current role is: LEADER
I20251211 21:05:05.302721 3408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [sys.catalog]: This master's current role is: LEADER
I20251211 21:05:05.302927 3414 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:05:05.303874 3414 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:05:05.304076 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:05:05.305624 3414 catalog_manager.cc:1357] Generated new cluster ID: 808e3cc958df4c098a162e3f0dd6c36e
I20251211 21:05:05.305681 3414 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:05:05.321802 3414 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:05:05.322394 3414 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:05:05.332078 3414 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549: Generated new TSK 0
I20251211 21:05:05.332275 3414 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:05:05.336349 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:05.338305 3428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:05.338376 3426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:05.338456 3425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:05.338534 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:05.338768 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:05.338809 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:05.338830 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487105338829 us; error 0 us; skew 500 ppm
I20251211 21:05:05.339689 30459 webserver.cc:492] Webserver started at http://127.29.190.193:34529/ using document root <none> and password file <none>
I20251211 21:05:05.339831 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:05.339879 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:05.339951 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:05.340340 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "e9fae2ced70d4387960f261e6366f2c8"
format_stamp: "Formatted at 2025-12-11 21:05:05 on dist-test-slave-xjj2"
I20251211 21:05:05.341681 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:05.342525 3433 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.342730 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:05.342792 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "e9fae2ced70d4387960f261e6366f2c8"
format_stamp: "Formatted at 2025-12-11 21:05:05 on dist-test-slave-xjj2"
I20251211 21:05:05.342859 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:05.346868 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:05.347194 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:05.347436 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:05.347910 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:05.347949 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.347987 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:05.348014 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.351854 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:36111
I20251211 21:05:05.351882 3496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:36111 every 8 connection(s)
I20251211 21:05:05.352669 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:05.354455 3502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:05.354471 3501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:05.354689 3504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:05.354725 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:05.354959 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:05.354997 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:05.355018 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487105355018 us; error 0 us; skew 500 ppm
I20251211 21:05:05.355983 30459 webserver.cc:492] Webserver started at http://127.29.190.194:44381/ using document root <none> and password file <none>
I20251211 21:05:05.356142 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:05.356194 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:05.356280 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:05.356637 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "92fc789f949a4156ad71247f312d881f"
format_stamp: "Formatted at 2025-12-11 21:05:05 on dist-test-slave-xjj2"
I20251211 21:05:05.357929 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:05.358716 3509 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.358916 30459 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251211 21:05:05.358975 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "92fc789f949a4156ad71247f312d881f"
format_stamp: "Formatted at 2025-12-11 21:05:05 on dist-test-slave-xjj2"
I20251211 21:05:05.359040 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:05.360679 3497 heartbeater.cc:344] Connected to a master server at 127.29.190.254:34521
I20251211 21:05:05.360761 3497 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:05.360958 3497 heartbeater.cc:507] Master 127.29.190.254:34521 requested a full tablet report, sending...
I20251211 21:05:05.361485 3368 ts_manager.cc:194] Registered new tserver with Master: e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111)
I20251211 21:05:05.362471 3368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52434
I20251211 21:05:05.377466 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:05.377864 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:05.378139 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:05.378618 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:05.378657 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.378691 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:05.378719 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.382797 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:36419
I20251211 21:05:05.382855 3572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:36419 every 8 connection(s)
I20251211 21:05:05.383581 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:05.385555 3577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:05.385555 3576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:05.385838 3579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:05.386073 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:05.386252 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:05.386289 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:05.386349 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487105386348 us; error 0 us; skew 500 ppm
I20251211 21:05:05.387182 30459 webserver.cc:492] Webserver started at http://127.29.190.195:35257/ using document root <none> and password file <none>
I20251211 21:05:05.387357 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:05.387408 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:05.387475 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:05.387694 3573 heartbeater.cc:344] Connected to a master server at 127.29.190.254:34521
I20251211 21:05:05.387787 3573 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:05.387939 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "206fd4dbe1d84e87a70c3a6caf903718"
format_stamp: "Formatted at 2025-12-11 21:05:05 on dist-test-slave-xjj2"
I20251211 21:05:05.387995 3573 heartbeater.cc:507] Master 127.29.190.254:34521 requested a full tablet report, sending...
I20251211 21:05:05.388562 3368 ts_manager.cc:194] Registered new tserver with Master: 92fc789f949a4156ad71247f312d881f (127.29.190.194:36419)
I20251211 21:05:05.389117 3368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52436
I20251211 21:05:05.389467 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:05.390328 3584 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.390537 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:05.390597 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "206fd4dbe1d84e87a70c3a6caf903718"
format_stamp: "Formatted at 2025-12-11 21:05:05 on dist-test-slave-xjj2"
I20251211 21:05:05.390666 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:05.403041 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:05.403496 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:05.403857 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:05.404341 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:05.404382 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.404423 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:05.404453 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:05.408977 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:34103
I20251211 21:05:05.409427 3647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:34103 every 8 connection(s)
I20251211 21:05:05.413198 3648 heartbeater.cc:344] Connected to a master server at 127.29.190.254:34521
I20251211 21:05:05.413295 3648 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:05.413519 3648 heartbeater.cc:507] Master 127.29.190.254:34521 requested a full tablet report, sending...
I20251211 21:05:05.414127 3368 ts_manager.cc:194] Registered new tserver with Master: 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195:34103)
I20251211 21:05:05.414664 3368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52440
I20251211 21:05:05.414971 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005564959s
I20251211 21:05:06.363284 3497 heartbeater.cc:499] Master 127.29.190.254:34521 was elected leader, sending a full tablet report...
I20251211 21:05:06.390015 3573 heartbeater.cc:499] Master 127.29.190.254:34521 was elected leader, sending a full tablet report...
I20251211 21:05:06.415656 3648 heartbeater.cc:499] Master 127.29.190.254:34521 was elected leader, sending a full tablet report...
I20251211 21:05:06.440881 30459 test_util.cc:276] Using random seed: 2144714413
I20251211 21:05:06.448863 3368 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52452:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:05:06.449525 3368 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:05:06.460040 3461 tablet_service.cc:1505] Processing CreateTablet for tablet 84a672dde59e4ecdbce8e521a8dcc495 (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:06.460448 3461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a672dde59e4ecdbce8e521a8dcc495. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.460631 3458 tablet_service.cc:1505] Processing CreateTablet for tablet 018b85a6951547159823e619bbb09c7c (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:06.460927 3458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018b85a6951547159823e619bbb09c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.462545 3668 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8: Bootstrap starting.
I20251211 21:05:06.463201 3459 tablet_service.cc:1505] Processing CreateTablet for tablet a55ad468620441689f41c441ab8adb1b (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:06.463464 3459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55ad468620441689f41c441ab8adb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.463435 3537 tablet_service.cc:1505] Processing CreateTablet for tablet 84a672dde59e4ecdbce8e521a8dcc495 (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:06.463675 3612 tablet_service.cc:1505] Processing CreateTablet for tablet 366d590ec71240369921263ec2072aca (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:06.463829 3460 tablet_service.cc:1505] Processing CreateTablet for tablet 366d590ec71240369921263ec2072aca (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:06.463920 3612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d590ec71240369921263ec2072aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.463838 3536 tablet_service.cc:1505] Processing CreateTablet for tablet 366d590ec71240369921263ec2072aca (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:06.464069 3460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d590ec71240369921263ec2072aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.464035 3535 tablet_service.cc:1505] Processing CreateTablet for tablet a55ad468620441689f41c441ab8adb1b (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:06.463841 3668 tablet_bootstrap.cc:654] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.464433 3534 tablet_service.cc:1505] Processing CreateTablet for tablet 018b85a6951547159823e619bbb09c7c (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:06.465945 3670 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718: Bootstrap starting.
I20251211 21:05:06.466100 3611 tablet_service.cc:1505] Processing CreateTablet for tablet a55ad468620441689f41c441ab8adb1b (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:06.466328 3611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55ad468620441689f41c441ab8adb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.466893 3670 tablet_bootstrap.cc:654] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.463469 3610 tablet_service.cc:1505] Processing CreateTablet for tablet 84a672dde59e4ecdbce8e521a8dcc495 (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:06.468431 3609 tablet_service.cc:1505] Processing CreateTablet for tablet 018b85a6951547159823e619bbb09c7c (DEFAULT_TABLE table=test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:06.468761 3610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a672dde59e4ecdbce8e521a8dcc495. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.463680 3537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a672dde59e4ecdbce8e521a8dcc495. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.468895 3609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018b85a6951547159823e619bbb09c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.469051 3535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55ad468620441689f41c441ab8adb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.470156 3536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d590ec71240369921263ec2072aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.470934 3534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018b85a6951547159823e619bbb09c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:06.472200 3668 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8: No bootstrap required, opened a new log
I20251211 21:05:06.472285 3668 ts_tablet_manager.cc:1403] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251211 21:05:06.472785 3670 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718: No bootstrap required, opened a new log
I20251211 21:05:06.472743 3668 raft_consensus.cc:359] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.472841 3668 raft_consensus.cc:385] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.472867 3670 ts_tablet_manager.cc:1403] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251211 21:05:06.472873 3668 raft_consensus.cc:740] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9fae2ced70d4387960f261e6366f2c8, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.473019 3668 consensus_queue.cc:260] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.473289 3670 raft_consensus.cc:359] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.473374 3670 raft_consensus.cc:385] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.473378 3668 ts_tablet_manager.cc:1434] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:06.473416 3670 raft_consensus.cc:740] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 206fd4dbe1d84e87a70c3a6caf903718, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.473670 3668 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8: Bootstrap starting.
I20251211 21:05:06.473673 3670 consensus_queue.cc:260] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.474009 3670 ts_tablet_manager.cc:1434] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:06.474174 3670 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718: Bootstrap starting.
I20251211 21:05:06.474960 3668 tablet_bootstrap.cc:654] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.475112 3670 tablet_bootstrap.cc:654] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.475695 3672 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f: Bootstrap starting.
I20251211 21:05:06.476297 3670 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718: No bootstrap required, opened a new log
I20251211 21:05:06.476385 3670 ts_tablet_manager.cc:1403] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:05:06.476778 3672 tablet_bootstrap.cc:654] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.476758 3670 raft_consensus.cc:359] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.476873 3670 raft_consensus.cc:385] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.476919 3670 raft_consensus.cc:740] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 206fd4dbe1d84e87a70c3a6caf903718, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.477034 3670 consensus_queue.cc:260] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.477391 3670 ts_tablet_manager.cc:1434] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:06.477571 3670 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718: Bootstrap starting.
I20251211 21:05:06.478073 3672 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f: No bootstrap required, opened a new log
I20251211 21:05:06.478163 3668 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8: No bootstrap required, opened a new log
I20251211 21:05:06.478168 3672 ts_tablet_manager.cc:1403] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251211 21:05:06.478247 3668 ts_tablet_manager.cc:1403] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20251211 21:05:06.478472 3670 tablet_bootstrap.cc:654] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.478636 3672 raft_consensus.cc:359] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.478745 3672 raft_consensus.cc:385] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.478782 3672 raft_consensus.cc:740] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fc789f949a4156ad71247f312d881f, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.478914 3672 consensus_queue.cc:260] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.479267 3672 ts_tablet_manager.cc:1434] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:06.479439 3672 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f: Bootstrap starting.
I20251211 21:05:06.479463 3668 raft_consensus.cc:359] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.479542 3668 raft_consensus.cc:385] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.479569 3668 raft_consensus.cc:740] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9fae2ced70d4387960f261e6366f2c8, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.479704 3668 consensus_queue.cc:260] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.479945 3668 ts_tablet_manager.cc:1434] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251211 21:05:06.480113 3668 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8: Bootstrap starting.
I20251211 21:05:06.480432 3672 tablet_bootstrap.cc:654] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.480994 3668 tablet_bootstrap.cc:654] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.481595 3672 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f: No bootstrap required, opened a new log
I20251211 21:05:06.481681 3672 ts_tablet_manager.cc:1403] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:06.482112 3672 raft_consensus.cc:359] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.482204 3672 raft_consensus.cc:385] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.482247 3672 raft_consensus.cc:740] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fc789f949a4156ad71247f312d881f, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.482367 3672 consensus_queue.cc:260] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.482607 3672 ts_tablet_manager.cc:1434] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:06.482775 3672 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f: Bootstrap starting.
I20251211 21:05:06.483345 3668 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8: No bootstrap required, opened a new log
I20251211 21:05:06.483434 3668 ts_tablet_manager.cc:1403] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251211 21:05:06.483775 3672 tablet_bootstrap.cc:654] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.483882 3668 raft_consensus.cc:359] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.483986 3668 raft_consensus.cc:385] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.484012 3668 raft_consensus.cc:740] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9fae2ced70d4387960f261e6366f2c8, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.484104 3668 consensus_queue.cc:260] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.484352 3668 ts_tablet_manager.cc:1434] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:06.484510 3668 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8: Bootstrap starting.
I20251211 21:05:06.485268 3668 tablet_bootstrap.cc:654] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.486308 3668 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8: No bootstrap required, opened a new log
I20251211 21:05:06.486393 3668 ts_tablet_manager.cc:1403] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:05:06.486805 3668 raft_consensus.cc:359] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.486903 3668 raft_consensus.cc:385] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.486919 3670 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718: No bootstrap required, opened a new log
I20251211 21:05:06.486940 3668 raft_consensus.cc:740] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9fae2ced70d4387960f261e6366f2c8, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.487001 3670 ts_tablet_manager.cc:1403] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20251211 21:05:06.487064 3668 consensus_queue.cc:260] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.487427 3668 ts_tablet_manager.cc:1434] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:06.487831 3670 raft_consensus.cc:359] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.487936 3670 raft_consensus.cc:385] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.487970 3670 raft_consensus.cc:740] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 206fd4dbe1d84e87a70c3a6caf903718, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.488117 3670 consensus_queue.cc:260] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.488178 3672 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f: No bootstrap required, opened a new log
I20251211 21:05:06.488523 3672 ts_tablet_manager.cc:1403] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251211 21:05:06.488933 3672 raft_consensus.cc:359] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.489027 3672 raft_consensus.cc:385] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.489044 3670 ts_tablet_manager.cc:1434] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:05:06.489061 3672 raft_consensus.cc:740] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fc789f949a4156ad71247f312d881f, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.489243 3670 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718: Bootstrap starting.
I20251211 21:05:06.489229 3672 consensus_queue.cc:260] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.489524 3672 ts_tablet_manager.cc:1434] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:06.489684 3672 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f: Bootstrap starting.
I20251211 21:05:06.491216 3672 tablet_bootstrap.cc:654] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.491217 3670 tablet_bootstrap.cc:654] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:06.492419 3672 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f: No bootstrap required, opened a new log
I20251211 21:05:06.492483 3670 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718: No bootstrap required, opened a new log
I20251211 21:05:06.492520 3672 ts_tablet_manager.cc:1403] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:06.492554 3670 ts_tablet_manager.cc:1403] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251211 21:05:06.492908 3672 raft_consensus.cc:359] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.492941 3670 raft_consensus.cc:359] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.493005 3672 raft_consensus.cc:385] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.493017 3670 raft_consensus.cc:385] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:06.493057 3672 raft_consensus.cc:740] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fc789f949a4156ad71247f312d881f, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.493067 3670 raft_consensus.cc:740] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 206fd4dbe1d84e87a70c3a6caf903718, State: Initialized, Role: FOLLOWER
I20251211 21:05:06.493191 3672 consensus_queue.cc:260] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.493211 3670 consensus_queue.cc:260] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.493453 3670 ts_tablet_manager.cc:1434] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:06.493462 3672 ts_tablet_manager.cc:1434] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:06.516608 3680 raft_consensus.cc:493] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:06.516765 3680 raft_consensus.cc:515] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.517351 3680 leader_election.cc:290] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111), 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195:34103)
I20251211 21:05:06.520772 3471 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "366d590ec71240369921263ec2072aca" candidate_uuid: "92fc789f949a4156ad71247f312d881f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9fae2ced70d4387960f261e6366f2c8" is_pre_election: true
I20251211 21:05:06.520772 3622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "366d590ec71240369921263ec2072aca" candidate_uuid: "92fc789f949a4156ad71247f312d881f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "206fd4dbe1d84e87a70c3a6caf903718" is_pre_election: true
I20251211 21:05:06.520942 3471 raft_consensus.cc:2468] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fc789f949a4156ad71247f312d881f in term 0.
I20251211 21:05:06.520947 3622 raft_consensus.cc:2468] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fc789f949a4156ad71247f312d881f in term 0.
I20251211 21:05:06.521224 3513 leader_election.cc:304] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fc789f949a4156ad71247f312d881f, e9fae2ced70d4387960f261e6366f2c8; no voters:
I20251211 21:05:06.521417 3680 raft_consensus.cc:2804] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:06.521479 3680 raft_consensus.cc:493] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:06.521507 3680 raft_consensus.cc:3060] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.522364 3680 raft_consensus.cc:515] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.522703 3680 leader_election.cc:290] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [CANDIDATE]: Term 1 election: Requested vote from peers e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111), 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195:34103)
I20251211 21:05:06.523053 3471 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "366d590ec71240369921263ec2072aca" candidate_uuid: "92fc789f949a4156ad71247f312d881f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9fae2ced70d4387960f261e6366f2c8"
I20251211 21:05:06.523146 3471 raft_consensus.cc:3060] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.523746 3622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "366d590ec71240369921263ec2072aca" candidate_uuid: "92fc789f949a4156ad71247f312d881f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "206fd4dbe1d84e87a70c3a6caf903718"
I20251211 21:05:06.523849 3622 raft_consensus.cc:3060] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.524061 3471 raft_consensus.cc:2468] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fc789f949a4156ad71247f312d881f in term 1.
I20251211 21:05:06.524317 3513 leader_election.cc:304] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fc789f949a4156ad71247f312d881f, e9fae2ced70d4387960f261e6366f2c8; no voters:
I20251211 21:05:06.524677 3622 raft_consensus.cc:2468] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fc789f949a4156ad71247f312d881f in term 1.
I20251211 21:05:06.524816 3680 raft_consensus.cc:2804] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:06.525004 3680 raft_consensus.cc:697] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Becoming Leader. State: Replica: 92fc789f949a4156ad71247f312d881f, State: Running, Role: LEADER
I20251211 21:05:06.525157 3680 consensus_queue.cc:237] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.526684 3365 catalog_manager.cc:5654] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fc789f949a4156ad71247f312d881f (127.29.190.194). New cstate: current_term: 1 leader_uuid: "92fc789f949a4156ad71247f312d881f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:06.606673 3674 raft_consensus.cc:493] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:06.606824 3674 raft_consensus.cc:515] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.607316 3674 leader_election.cc:290] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111), 92fc789f949a4156ad71247f312d881f (127.29.190.194:36419)
I20251211 21:05:06.610800 3471 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a55ad468620441689f41c441ab8adb1b" candidate_uuid: "206fd4dbe1d84e87a70c3a6caf903718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9fae2ced70d4387960f261e6366f2c8" is_pre_election: true
I20251211 21:05:06.610806 3547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a55ad468620441689f41c441ab8adb1b" candidate_uuid: "206fd4dbe1d84e87a70c3a6caf903718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fc789f949a4156ad71247f312d881f" is_pre_election: true
I20251211 21:05:06.610954 3471 raft_consensus.cc:2468] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 206fd4dbe1d84e87a70c3a6caf903718 in term 0.
I20251211 21:05:06.610983 3547 raft_consensus.cc:2468] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 206fd4dbe1d84e87a70c3a6caf903718 in term 0.
I20251211 21:05:06.611246 3588 leader_election.cc:304] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206fd4dbe1d84e87a70c3a6caf903718, e9fae2ced70d4387960f261e6366f2c8; no voters:
I20251211 21:05:06.611289 3674 raft_consensus.cc:493] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:06.611382 3674 raft_consensus.cc:515] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.611459 3677 raft_consensus.cc:2804] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:06.611521 3677 raft_consensus.cc:493] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:06.611572 3677 raft_consensus.cc:3060] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.611748 3674 leader_election.cc:290] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111), 92fc789f949a4156ad71247f312d881f (127.29.190.194:36419)
I20251211 21:05:06.612021 3471 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84a672dde59e4ecdbce8e521a8dcc495" candidate_uuid: "206fd4dbe1d84e87a70c3a6caf903718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9fae2ced70d4387960f261e6366f2c8" is_pre_election: true
I20251211 21:05:06.612033 3547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84a672dde59e4ecdbce8e521a8dcc495" candidate_uuid: "206fd4dbe1d84e87a70c3a6caf903718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fc789f949a4156ad71247f312d881f" is_pre_election: true
I20251211 21:05:06.612125 3471 raft_consensus.cc:2468] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 206fd4dbe1d84e87a70c3a6caf903718 in term 0.
I20251211 21:05:06.612147 3547 raft_consensus.cc:2468] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 206fd4dbe1d84e87a70c3a6caf903718 in term 0.
I20251211 21:05:06.612344 3588 leader_election.cc:304] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206fd4dbe1d84e87a70c3a6caf903718, e9fae2ced70d4387960f261e6366f2c8; no voters:
I20251211 21:05:06.612483 3674 raft_consensus.cc:2804] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:06.612540 3674 raft_consensus.cc:493] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:06.612579 3674 raft_consensus.cc:3060] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.612733 3677 raft_consensus.cc:515] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.613039 3677 leader_election.cc:290] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [CANDIDATE]: Term 1 election: Requested vote from peers e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111), 92fc789f949a4156ad71247f312d881f (127.29.190.194:36419)
I20251211 21:05:06.613332 3471 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a55ad468620441689f41c441ab8adb1b" candidate_uuid: "206fd4dbe1d84e87a70c3a6caf903718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9fae2ced70d4387960f261e6366f2c8"
I20251211 21:05:06.613418 3471 raft_consensus.cc:3060] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.613628 3674 raft_consensus.cc:515] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.613935 3674 leader_election.cc:290] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [CANDIDATE]: Term 1 election: Requested vote from peers e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111), 92fc789f949a4156ad71247f312d881f (127.29.190.194:36419)
I20251211 21:05:06.614146 3471 raft_consensus.cc:2468] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 206fd4dbe1d84e87a70c3a6caf903718 in term 1.
I20251211 21:05:06.614197 3547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a55ad468620441689f41c441ab8adb1b" candidate_uuid: "206fd4dbe1d84e87a70c3a6caf903718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fc789f949a4156ad71247f312d881f"
I20251211 21:05:06.614248 3546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84a672dde59e4ecdbce8e521a8dcc495" candidate_uuid: "206fd4dbe1d84e87a70c3a6caf903718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fc789f949a4156ad71247f312d881f"
I20251211 21:05:06.614251 3470 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84a672dde59e4ecdbce8e521a8dcc495" candidate_uuid: "206fd4dbe1d84e87a70c3a6caf903718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9fae2ced70d4387960f261e6366f2c8"
I20251211 21:05:06.614353 3546 raft_consensus.cc:3060] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.614369 3470 raft_consensus.cc:3060] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.614408 3588 leader_election.cc:304] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206fd4dbe1d84e87a70c3a6caf903718, e9fae2ced70d4387960f261e6366f2c8; no voters:
I20251211 21:05:06.614655 3674 raft_consensus.cc:2804] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:06.614734 3674 raft_consensus.cc:697] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Becoming Leader. State: Replica: 206fd4dbe1d84e87a70c3a6caf903718, State: Running, Role: LEADER
I20251211 21:05:06.614861 3674 consensus_queue.cc:237] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.614285 3547 raft_consensus.cc:3060] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.615242 3470 raft_consensus.cc:2468] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 206fd4dbe1d84e87a70c3a6caf903718 in term 1.
I20251211 21:05:06.615242 3546 raft_consensus.cc:2468] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 206fd4dbe1d84e87a70c3a6caf903718 in term 1.
I20251211 21:05:06.615566 3585 leader_election.cc:304] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206fd4dbe1d84e87a70c3a6caf903718, 92fc789f949a4156ad71247f312d881f; no voters:
I20251211 21:05:06.615978 3674 raft_consensus.cc:2804] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:06.616057 3674 raft_consensus.cc:697] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Becoming Leader. State: Replica: 206fd4dbe1d84e87a70c3a6caf903718, State: Running, Role: LEADER
I20251211 21:05:06.616150 3674 consensus_queue.cc:237] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.616195 3547 raft_consensus.cc:2468] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 206fd4dbe1d84e87a70c3a6caf903718 in term 1.
I20251211 21:05:06.616897 3365 catalog_manager.cc:5654] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "206fd4dbe1d84e87a70c3a6caf903718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:06.619776 3365 catalog_manager.cc:5654] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "206fd4dbe1d84e87a70c3a6caf903718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:06.782573 3680 raft_consensus.cc:493] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:06.782728 3680 raft_consensus.cc:515] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.783149 3680 leader_election.cc:290] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111), 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195:34103)
I20251211 21:05:06.783592 3470 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018b85a6951547159823e619bbb09c7c" candidate_uuid: "92fc789f949a4156ad71247f312d881f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9fae2ced70d4387960f261e6366f2c8" is_pre_election: true
I20251211 21:05:06.783593 3622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018b85a6951547159823e619bbb09c7c" candidate_uuid: "92fc789f949a4156ad71247f312d881f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "206fd4dbe1d84e87a70c3a6caf903718" is_pre_election: true
I20251211 21:05:06.783761 3470 raft_consensus.cc:2468] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fc789f949a4156ad71247f312d881f in term 0.
I20251211 21:05:06.783776 3622 raft_consensus.cc:2468] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fc789f949a4156ad71247f312d881f in term 0.
I20251211 21:05:06.784049 3513 leader_election.cc:304] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fc789f949a4156ad71247f312d881f, e9fae2ced70d4387960f261e6366f2c8; no voters:
I20251211 21:05:06.784202 3680 raft_consensus.cc:2804] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:06.784257 3680 raft_consensus.cc:493] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:06.784297 3680 raft_consensus.cc:3060] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.785197 3680 raft_consensus.cc:515] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.785534 3680 leader_election.cc:290] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [CANDIDATE]: Term 1 election: Requested vote from peers e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111), 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195:34103)
I20251211 21:05:06.785838 3622 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018b85a6951547159823e619bbb09c7c" candidate_uuid: "92fc789f949a4156ad71247f312d881f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "206fd4dbe1d84e87a70c3a6caf903718"
I20251211 21:05:06.785838 3470 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018b85a6951547159823e619bbb09c7c" candidate_uuid: "92fc789f949a4156ad71247f312d881f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9fae2ced70d4387960f261e6366f2c8"
I20251211 21:05:06.785972 3470 raft_consensus.cc:3060] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.785972 3622 raft_consensus.cc:3060] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:06.786892 3470 raft_consensus.cc:2468] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fc789f949a4156ad71247f312d881f in term 1.
I20251211 21:05:06.786892 3622 raft_consensus.cc:2468] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fc789f949a4156ad71247f312d881f in term 1.
I20251211 21:05:06.787202 3513 leader_election.cc:304] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fc789f949a4156ad71247f312d881f, e9fae2ced70d4387960f261e6366f2c8; no voters:
I20251211 21:05:06.787371 3680 raft_consensus.cc:2804] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:06.787453 3680 raft_consensus.cc:697] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Becoming Leader. State: Replica: 92fc789f949a4156ad71247f312d881f, State: Running, Role: LEADER
I20251211 21:05:06.787582 3680 consensus_queue.cc:237] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } }
I20251211 21:05:06.789124 3365 catalog_manager.cc:5654] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fc789f949a4156ad71247f312d881f (127.29.190.194). New cstate: current_term: 1 leader_uuid: "92fc789f949a4156ad71247f312d881f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:06.824958 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:05:06.828346 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:06.828608 30459 tablet_replica.cc:333] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8: stopping tablet replica
I20251211 21:05:06.828724 30459 raft_consensus.cc:2243] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:06.828828 30459 raft_consensus.cc:2272] T 366d590ec71240369921263ec2072aca P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:06.829281 30459 tablet_replica.cc:333] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8: stopping tablet replica
I20251211 21:05:06.829360 30459 raft_consensus.cc:2243] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:06.829432 30459 raft_consensus.cc:2272] T a55ad468620441689f41c441ab8adb1b P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:06.829752 30459 tablet_replica.cc:333] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8: stopping tablet replica
I20251211 21:05:06.829821 30459 raft_consensus.cc:2243] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:06.829883 30459 raft_consensus.cc:2272] T 84a672dde59e4ecdbce8e521a8dcc495 P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:06.830180 30459 tablet_replica.cc:333] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8: stopping tablet replica
I20251211 21:05:06.830243 30459 raft_consensus.cc:2243] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:06.830313 30459 raft_consensus.cc:2272] T 018b85a6951547159823e619bbb09c7c P e9fae2ced70d4387960f261e6366f2c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:06.843393 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:05:07.039826 3674 consensus_queue.cc:1048] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 21:05:07.043352 3588 consensus_peers.cc:597] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251211 21:05:07.065120 3513 consensus_peers.cc:597] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251211 21:05:07.073894 3588 consensus_peers.cc:597] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:07.077854 3674 consensus_queue.cc:1048] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:07.099664 3680 consensus_queue.cc:1048] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 21:05:07.351533 3513 consensus_peers.cc:597] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:07.405351 3680 consensus_queue.cc:1048] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:07.525671 3680 consensus_queue.cc:579] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Leader has been unable to successfully communicate with peer e9fae2ced70d4387960f261e6366f2c8 for more than 1 seconds (1.000s)
W20251211 21:05:07.527544 3365 catalog_manager.cc:5332] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 366d590ec71240369921263ec2072aca with cas_config_opid_index -1: no extra replica candidate found for tablet 366d590ec71240369921263ec2072aca (table test-workload [id=2ac7ed9327af48ce9ad637e2d3be453d]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20251211 21:05:07.846803 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:05:07.847517 3680 consensus_queue.cc:579] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Leader has been unable to successfully communicate with peer e9fae2ced70d4387960f261e6366f2c8 for more than 1 seconds (1.060s)
W20251211 21:05:07.848680 3706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:07.848760 3709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:07.849306 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:07.849335 3707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:07.849603 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:07.849651 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:07.849671 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487107849671 us; error 0 us; skew 500 ppm
I20251211 21:05:07.850558 30459 webserver.cc:492] Webserver started at http://127.29.190.196:35447/ using document root <none> and password file <none>
I20251211 21:05:07.850695 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:07.850746 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:07.850817 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:07.851176 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-3-root/instance:
uuid: "252e769aa7314cb686e07846d01becd6"
format_stamp: "Formatted at 2025-12-11 21:05:07 on dist-test-slave-xjj2"
I20251211 21:05:07.852591 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:07.853475 3714 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:07.853695 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:07.853757 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-3-root
uuid: "252e769aa7314cb686e07846d01becd6"
format_stamp: "Formatted at 2025-12-11 21:05:07 on dist-test-slave-xjj2"
I20251211 21:05:07.853822 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765486953797919-30459-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:07.860311 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:07.860608 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:07.860852 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:07.861268 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:07.861306 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:07.861346 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:07.861370 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:07.865363 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.196:39693
I20251211 21:05:07.865816 3777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.196:39693 every 8 connection(s)
I20251211 21:05:07.869908 3778 heartbeater.cc:344] Connected to a master server at 127.29.190.254:34521
I20251211 21:05:07.870014 3778 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:07.870237 3778 heartbeater.cc:507] Master 127.29.190.254:34521 requested a full tablet report, sending...
I20251211 21:05:07.870754 3365 ts_manager.cc:194] Registered new tserver with Master: 252e769aa7314cb686e07846d01becd6 (127.29.190.196:39693)
I20251211 21:05:07.871279 3365 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52466
I20251211 21:05:07.891933 3547 consensus_queue.cc:237] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:07.893386 3622 raft_consensus.cc:1275] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:05:07.893795 3705 consensus_queue.cc:1048] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251211 21:05:07.894325 3513 consensus_peers.cc:597] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:07.895396 3680 raft_consensus.cc:2955] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
I20251211 21:05:07.895825 3622 raft_consensus.cc:2955] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
W20251211 21:05:07.897290 3511 consensus_peers.cc:597] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f -> Peer 252e769aa7314cb686e07846d01becd6 (127.29.190.196:39693): Couldn't send request to peer 252e769aa7314cb686e07846d01becd6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 018b85a6951547159823e619bbb09c7c. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:07.897404 3352 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 018b85a6951547159823e619bbb09c7c with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 2)
I20251211 21:05:07.898008 3366 catalog_manager.cc:5654] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "92fc789f949a4156ad71247f312d881f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
I20251211 21:05:07.901310 3547 consensus_queue.cc:237] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:07.902362 3622 raft_consensus.cc:1275] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251211 21:05:07.902573 3511 consensus_peers.cc:597] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f -> Peer 252e769aa7314cb686e07846d01becd6 (127.29.190.196:39693): Couldn't send request to peer 252e769aa7314cb686e07846d01becd6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 366d590ec71240369921263ec2072aca. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:07.902717 3705 consensus_queue.cc:1048] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251211 21:05:07.903023 3513 consensus_peers.cc:597] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:07.904013 3680 raft_consensus.cc:2955] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
I20251211 21:05:07.904405 3622 raft_consensus.cc:2955] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
I20251211 21:05:07.905915 3352 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 366d590ec71240369921263ec2072aca with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 5)
I20251211 21:05:07.906322 3365 catalog_manager.cc:5654] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f reported cstate change: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "92fc789f949a4156ad71247f312d881f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:08.030359 3674 consensus_queue.cc:579] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Leader has been unable to successfully communicate with peer e9fae2ced70d4387960f261e6366f2c8 for more than 1 seconds (1.414s)
I20251211 21:05:08.032992 3622 consensus_queue.cc:237] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.034318 3547 raft_consensus.cc:1275] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:05:08.034796 3789 consensus_queue.cc:1048] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251211 21:05:08.035060 3588 consensus_peers.cc:597] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:08.036285 3790 raft_consensus.cc:2955] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
I20251211 21:05:08.036633 3547 raft_consensus.cc:2955] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
I20251211 21:05:08.038396 3354 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 84a672dde59e4ecdbce8e521a8dcc495 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251211 21:05:08.038631 3366 catalog_manager.cc:5654] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "206fd4dbe1d84e87a70c3a6caf903718" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251211 21:05:08.038797 3586 consensus_peers.cc:597] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 -> Peer 252e769aa7314cb686e07846d01becd6 (127.29.190.196:39693): Couldn't send request to peer 252e769aa7314cb686e07846d01becd6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84a672dde59e4ecdbce8e521a8dcc495. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:08.042560 3790 consensus_queue.cc:579] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Leader has been unable to successfully communicate with peer e9fae2ced70d4387960f261e6366f2c8 for more than 1 seconds (1.427s)
I20251211 21:05:08.044512 3622 consensus_queue.cc:237] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.045933 3547 raft_consensus.cc:1275] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251211 21:05:08.046053 3586 consensus_peers.cc:597] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 -> Peer 252e769aa7314cb686e07846d01becd6 (127.29.190.196:39693): Couldn't send request to peer 252e769aa7314cb686e07846d01becd6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a55ad468620441689f41c441ab8adb1b. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:08.046244 3789 consensus_queue.cc:1048] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251211 21:05:08.046368 3588 consensus_peers.cc:597] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:08.047420 3790 raft_consensus.cc:2955] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
I20251211 21:05:08.047845 3547 raft_consensus.cc:2955] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } } }
I20251211 21:05:08.049068 3354 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a55ad468620441689f41c441ab8adb1b with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251211 21:05:08.049698 3365 catalog_manager.cc:5654] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index -1 to 2, NON_VOTER 252e769aa7314cb686e07846d01becd6 (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "206fd4dbe1d84e87a70c3a6caf903718" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251211 21:05:08.305145 3416 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver e9fae2ced70d4387960f261e6366f2c8 not available for placement
I20251211 21:05:08.386406 3793 ts_tablet_manager.cc:933] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: Initiating tablet copy from peer 92fc789f949a4156ad71247f312d881f (127.29.190.194:36419)
I20251211 21:05:08.386703 3793 tablet_copy_client.cc:323] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:36419
I20251211 21:05:08.390177 3557 tablet_copy_service.cc:140] P 92fc789f949a4156ad71247f312d881f: Received BeginTabletCopySession request for tablet 366d590ec71240369921263ec2072aca from peer 252e769aa7314cb686e07846d01becd6 ({username='slave'} at 127.0.0.1:32954)
I20251211 21:05:08.390300 3557 tablet_copy_service.cc:161] P 92fc789f949a4156ad71247f312d881f: Beginning new tablet copy session on tablet 366d590ec71240369921263ec2072aca from peer 252e769aa7314cb686e07846d01becd6 at {username='slave'} at 127.0.0.1:32954: session id = 252e769aa7314cb686e07846d01becd6-366d590ec71240369921263ec2072aca
I20251211 21:05:08.391098 3557 tablet_copy_source_session.cc:215] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:08.392009 3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d590ec71240369921263ec2072aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:08.395447 3793 tablet_copy_client.cc:806] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:08.395593 3793 tablet_copy_client.cc:670] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:08.396632 3793 tablet_copy_client.cc:538] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:08.397701 3793 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: Bootstrap starting.
I20251211 21:05:08.400513 3793 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:08.400722 3793 tablet_bootstrap.cc:492] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: Bootstrap complete.
I20251211 21:05:08.400867 3793 ts_tablet_manager.cc:1403] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20251211 21:05:08.401234 3793 raft_consensus.cc:359] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.401350 3793 raft_consensus.cc:740] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 252e769aa7314cb686e07846d01becd6, State: Initialized, Role: LEARNER
I20251211 21:05:08.401427 3793 consensus_queue.cc:260] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.401744 3793 ts_tablet_manager.cc:1434] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:08.401846 3778 heartbeater.cc:499] Master 127.29.190.254:34521 was elected leader, sending a full tablet report...
I20251211 21:05:08.402236 3557 tablet_copy_service.cc:342] P 92fc789f949a4156ad71247f312d881f: Request end of tablet copy session 252e769aa7314cb686e07846d01becd6-366d590ec71240369921263ec2072aca received from {username='slave'} at 127.0.0.1:32954
I20251211 21:05:08.402323 3557 tablet_copy_service.cc:434] P 92fc789f949a4156ad71247f312d881f: ending tablet copy session 252e769aa7314cb686e07846d01becd6-366d590ec71240369921263ec2072aca on tablet 366d590ec71240369921263ec2072aca with peer 252e769aa7314cb686e07846d01becd6
I20251211 21:05:08.403885 3793 ts_tablet_manager.cc:933] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: Initiating tablet copy from peer 92fc789f949a4156ad71247f312d881f (127.29.190.194:36419)
I20251211 21:05:08.404171 3793 tablet_copy_client.cc:323] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:36419
I20251211 21:05:08.404544 3557 tablet_copy_service.cc:140] P 92fc789f949a4156ad71247f312d881f: Received BeginTabletCopySession request for tablet 018b85a6951547159823e619bbb09c7c from peer 252e769aa7314cb686e07846d01becd6 ({username='slave'} at 127.0.0.1:32954)
I20251211 21:05:08.404649 3557 tablet_copy_service.cc:161] P 92fc789f949a4156ad71247f312d881f: Beginning new tablet copy session on tablet 018b85a6951547159823e619bbb09c7c from peer 252e769aa7314cb686e07846d01becd6 at {username='slave'} at 127.0.0.1:32954: session id = 252e769aa7314cb686e07846d01becd6-018b85a6951547159823e619bbb09c7c
I20251211 21:05:08.405371 3557 tablet_copy_source_session.cc:215] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:08.406203 3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018b85a6951547159823e619bbb09c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:08.407964 3793 tablet_copy_client.cc:806] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:08.408102 3793 tablet_copy_client.cc:670] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:08.409067 3793 tablet_copy_client.cc:538] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:08.410142 3793 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: Bootstrap starting.
I20251211 21:05:08.412833 3793 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:08.413053 3793 tablet_bootstrap.cc:492] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: Bootstrap complete.
I20251211 21:05:08.413188 3793 ts_tablet_manager.cc:1403] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20251211 21:05:08.413525 3793 raft_consensus.cc:359] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.413622 3793 raft_consensus.cc:740] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 252e769aa7314cb686e07846d01becd6, State: Initialized, Role: LEARNER
I20251211 21:05:08.413724 3793 consensus_queue.cc:260] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.413940 3793 ts_tablet_manager.cc:1434] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:08.414407 3557 tablet_copy_service.cc:342] P 92fc789f949a4156ad71247f312d881f: Request end of tablet copy session 252e769aa7314cb686e07846d01becd6-018b85a6951547159823e619bbb09c7c received from {username='slave'} at 127.0.0.1:32954
I20251211 21:05:08.414481 3557 tablet_copy_service.cc:434] P 92fc789f949a4156ad71247f312d881f: ending tablet copy session 252e769aa7314cb686e07846d01becd6-018b85a6951547159823e619bbb09c7c on tablet 018b85a6951547159823e619bbb09c7c with peer 252e769aa7314cb686e07846d01becd6
I20251211 21:05:08.433589 3793 ts_tablet_manager.cc:933] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: Initiating tablet copy from peer 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195:34103)
I20251211 21:05:08.433921 3793 tablet_copy_client.cc:323] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:34103
I20251211 21:05:08.437091 3632 tablet_copy_service.cc:140] P 206fd4dbe1d84e87a70c3a6caf903718: Received BeginTabletCopySession request for tablet 84a672dde59e4ecdbce8e521a8dcc495 from peer 252e769aa7314cb686e07846d01becd6 ({username='slave'} at 127.0.0.1:38384)
I20251211 21:05:08.437202 3632 tablet_copy_service.cc:161] P 206fd4dbe1d84e87a70c3a6caf903718: Beginning new tablet copy session on tablet 84a672dde59e4ecdbce8e521a8dcc495 from peer 252e769aa7314cb686e07846d01becd6 at {username='slave'} at 127.0.0.1:38384: session id = 252e769aa7314cb686e07846d01becd6-84a672dde59e4ecdbce8e521a8dcc495
I20251211 21:05:08.437987 3632 tablet_copy_source_session.cc:215] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:08.438782 3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a672dde59e4ecdbce8e521a8dcc495. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:08.440593 3793 tablet_copy_client.cc:806] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:08.440745 3793 tablet_copy_client.cc:670] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:08.441877 3793 tablet_copy_client.cc:538] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:08.442919 3793 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: Bootstrap starting.
I20251211 21:05:08.445607 3804 ts_tablet_manager.cc:933] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: Initiating tablet copy from peer 206fd4dbe1d84e87a70c3a6caf903718 (127.29.190.195:34103)
I20251211 21:05:08.445776 3793 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:08.445883 3804 tablet_copy_client.cc:323] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:34103
I20251211 21:05:08.445999 3793 tablet_bootstrap.cc:492] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: Bootstrap complete.
I20251211 21:05:08.446163 3793 ts_tablet_manager.cc:1403] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20251211 21:05:08.446295 3632 tablet_copy_service.cc:140] P 206fd4dbe1d84e87a70c3a6caf903718: Received BeginTabletCopySession request for tablet a55ad468620441689f41c441ab8adb1b from peer 252e769aa7314cb686e07846d01becd6 ({username='slave'} at 127.0.0.1:38384)
I20251211 21:05:08.446375 3632 tablet_copy_service.cc:161] P 206fd4dbe1d84e87a70c3a6caf903718: Beginning new tablet copy session on tablet a55ad468620441689f41c441ab8adb1b from peer 252e769aa7314cb686e07846d01becd6 at {username='slave'} at 127.0.0.1:38384: session id = 252e769aa7314cb686e07846d01becd6-a55ad468620441689f41c441ab8adb1b
I20251211 21:05:08.446552 3793 raft_consensus.cc:359] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.446650 3793 raft_consensus.cc:740] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 252e769aa7314cb686e07846d01becd6, State: Initialized, Role: LEARNER
I20251211 21:05:08.446727 3793 consensus_queue.cc:260] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.446976 3793 ts_tablet_manager.cc:1434] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:08.447311 3632 tablet_copy_source_session.cc:215] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:08.447407 3631 tablet_copy_service.cc:342] P 206fd4dbe1d84e87a70c3a6caf903718: Request end of tablet copy session 252e769aa7314cb686e07846d01becd6-84a672dde59e4ecdbce8e521a8dcc495 received from {username='slave'} at 127.0.0.1:38384
I20251211 21:05:08.447479 3631 tablet_copy_service.cc:434] P 206fd4dbe1d84e87a70c3a6caf903718: ending tablet copy session 252e769aa7314cb686e07846d01becd6-84a672dde59e4ecdbce8e521a8dcc495 on tablet 84a672dde59e4ecdbce8e521a8dcc495 with peer 252e769aa7314cb686e07846d01becd6
I20251211 21:05:08.448032 3804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55ad468620441689f41c441ab8adb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:08.449755 3804 tablet_copy_client.cc:806] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:08.449884 3804 tablet_copy_client.cc:670] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:08.450706 3804 tablet_copy_client.cc:538] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:08.451681 3804 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: Bootstrap starting.
I20251211 21:05:08.454391 3804 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:08.454558 3804 tablet_bootstrap.cc:492] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: Bootstrap complete.
I20251211 21:05:08.454674 3804 ts_tablet_manager.cc:1403] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:08.455008 3804 raft_consensus.cc:359] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.455111 3804 raft_consensus.cc:740] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 252e769aa7314cb686e07846d01becd6, State: Initialized, Role: LEARNER
I20251211 21:05:08.455183 3804 consensus_queue.cc:260] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: true } }
I20251211 21:05:08.455418 3804 ts_tablet_manager.cc:1434] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:08.455890 3631 tablet_copy_service.cc:342] P 206fd4dbe1d84e87a70c3a6caf903718: Request end of tablet copy session 252e769aa7314cb686e07846d01becd6-a55ad468620441689f41c441ab8adb1b received from {username='slave'} at 127.0.0.1:38384
I20251211 21:05:08.455978 3631 tablet_copy_service.cc:434] P 206fd4dbe1d84e87a70c3a6caf903718: ending tablet copy session 252e769aa7314cb686e07846d01becd6-a55ad468620441689f41c441ab8adb1b on tablet a55ad468620441689f41c441ab8adb1b with peer 252e769aa7314cb686e07846d01becd6
I20251211 21:05:08.861979 3752 raft_consensus.cc:1217] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251211 21:05:08.862753 3752 raft_consensus.cc:1217] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251211 21:05:08.913901 3752 raft_consensus.cc:1217] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251211 21:05:08.978089 3752 raft_consensus.cc:1217] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251211 21:05:09.080579 3789 consensus_queue.cc:579] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Leader has been unable to successfully communicate with peer e9fae2ced70d4387960f261e6366f2c8 for more than 1 seconds (1.047s)
W20251211 21:05:09.305759 3416 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver e9fae2ced70d4387960f261e6366f2c8 not available for placement
I20251211 21:05:09.328600 3705 consensus_queue.cc:579] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Leader has been unable to successfully communicate with peer e9fae2ced70d4387960f261e6366f2c8 for more than 1 seconds (1.427s)
I20251211 21:05:09.339941 3810 consensus_queue.cc:579] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Leader has been unable to successfully communicate with peer e9fae2ced70d4387960f261e6366f2c8 for more than 1 seconds (1.448s)
I20251211 21:05:09.354965 3808 raft_consensus.cc:1064] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718: attempting to promote NON_VOTER 252e769aa7314cb686e07846d01becd6 to VOTER
I20251211 21:05:09.355414 3808 consensus_queue.cc:237] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } }
I20251211 21:05:09.356742 3547 raft_consensus.cc:1275] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:09.356757 3752 raft_consensus.cc:1275] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:09.357110 3808 consensus_queue.cc:1048] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:09.357251 3789 consensus_queue.cc:1048] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251211 21:05:09.357445 3588 consensus_peers.cc:597] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:09.358767 3789 raft_consensus.cc:2955] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.359169 3752 raft_consensus.cc:2955] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.360476 3547 raft_consensus.cc:2955] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.361099 3366 catalog_manager.cc:5654] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "206fd4dbe1d84e87a70c3a6caf903718" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:05:09.364267 3622 consensus_queue.cc:237] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } }
I20251211 21:05:09.365255 3752 raft_consensus.cc:1275] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:09.365263 3547 raft_consensus.cc:1275] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:09.365603 3813 consensus_queue.cc:1048] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:09.365739 3808 consensus_queue.cc:1048] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:09.366940 3813 raft_consensus.cc:2955] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.367517 3547 raft_consensus.cc:2955] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.367703 3752 raft_consensus.cc:2955] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.368974 3354 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 84a672dde59e4ecdbce8e521a8dcc495 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:09.369525 3368 catalog_manager.cc:5654] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "206fd4dbe1d84e87a70c3a6caf903718" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251211 21:05:09.372776 3355 catalog_manager.cc:4712] TS e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 84a672dde59e4ecdbce8e521a8dcc495: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111)
I20251211 21:05:09.410403 3811 raft_consensus.cc:1064] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f: attempting to promote NON_VOTER 252e769aa7314cb686e07846d01becd6 to VOTER
I20251211 21:05:09.410804 3811 consensus_queue.cc:237] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } }
I20251211 21:05:09.412177 3622 raft_consensus.cc:1275] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:09.412174 3752 raft_consensus.cc:1275] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:09.412722 3809 consensus_queue.cc:1048] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251211 21:05:09.412866 3513 consensus_peers.cc:597] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:09.412976 3811 consensus_queue.cc:1048] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:09.414479 3809 raft_consensus.cc:2955] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.416034 3622 raft_consensus.cc:2955] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.416227 3752 raft_consensus.cc:2955] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.416690 3365 catalog_manager.cc:5654] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f reported cstate change: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92fc789f949a4156ad71247f312d881f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:05:09.419315 3547 consensus_queue.cc:237] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } }
I20251211 21:05:09.420305 3752 raft_consensus.cc:1275] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:09.420464 3622 raft_consensus.cc:1275] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:09.420801 3810 consensus_queue.cc:1048] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:09.420943 3705 consensus_queue.cc:1048] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:09.422222 3811 raft_consensus.cc:2955] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.422645 3622 raft_consensus.cc:2955] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.422654 3752 raft_consensus.cc:2955] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.424028 3352 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 366d590ec71240369921263ec2072aca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:09.424521 3368 catalog_manager.cc:5654] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "92fc789f949a4156ad71247f312d881f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.428774 3810 raft_consensus.cc:1064] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f: attempting to promote NON_VOTER 252e769aa7314cb686e07846d01becd6 to VOTER
I20251211 21:05:09.429073 3810 consensus_queue.cc:237] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } }
I20251211 21:05:09.430296 3622 raft_consensus.cc:1275] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:09.430361 3752 raft_consensus.cc:1275] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:09.430617 3809 consensus_queue.cc:1048] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251211 21:05:09.430765 3513 consensus_peers.cc:597] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:09.430804 3705 consensus_queue.cc:1048] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:09.432354 3809 raft_consensus.cc:2955] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.432682 3622 raft_consensus.cc:2955] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.433900 3752 raft_consensus.cc:2955] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.434381 3365 catalog_manager.cc:5654] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f reported cstate change: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92fc789f949a4156ad71247f312d881f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:05:09.436888 3547 consensus_queue.cc:237] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } }
I20251211 21:05:09.438036 3622 raft_consensus.cc:1275] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:09.438355 3811 consensus_queue.cc:1048] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:09.438432 3752 raft_consensus.cc:1275] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Refusing update from remote peer 92fc789f949a4156ad71247f312d881f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:09.438735 3811 consensus_queue.cc:1048] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [LEADER]: Connected to new peer: Peer: permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:09.439646 3810 raft_consensus.cc:2955] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.440042 3622 raft_consensus.cc:2955] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.440857 3352 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 018b85a6951547159823e619bbb09c7c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:09.441833 3368 catalog_manager.cc:5654] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "92fc789f949a4156ad71247f312d881f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.441898 3752 raft_consensus.cc:2955] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.461338 3807 raft_consensus.cc:1064] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718: attempting to promote NON_VOTER 252e769aa7314cb686e07846d01becd6 to VOTER
I20251211 21:05:09.461752 3807 consensus_queue.cc:237] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } }
I20251211 21:05:09.463032 3752 raft_consensus.cc:1275] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 LEARNER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:09.463033 3547 raft_consensus.cc:1275] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:09.463465 3808 consensus_queue.cc:1048] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251211 21:05:09.463590 3588 consensus_peers.cc:597] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 -> Peer e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): Couldn't send request to peer e9fae2ced70d4387960f261e6366f2c8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:09.463630 3789 consensus_queue.cc:1048] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:09.465169 3789 raft_consensus.cc:2955] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.465566 3547 raft_consensus.cc:2955] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.466814 3752 raft_consensus.cc:2955] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.467399 3365 catalog_manager.cc:5654] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index 2 to 3, 252e769aa7314cb686e07846d01becd6 (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "206fd4dbe1d84e87a70c3a6caf903718" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e9fae2ced70d4387960f261e6366f2c8" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:05:09.469859 3622 consensus_queue.cc:237] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } }
I20251211 21:05:09.470826 3547 raft_consensus.cc:1275] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:09.471081 3752 raft_consensus.cc:1275] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Refusing update from remote peer 206fd4dbe1d84e87a70c3a6caf903718: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:09.471134 3807 consensus_queue.cc:1048] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:09.471381 3808 consensus_queue.cc:1048] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:09.472429 3807 raft_consensus.cc:2955] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.472972 3752 raft_consensus.cc:2955] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.473716 3354 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet a55ad468620441689f41c441ab8adb1b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:09.473829 3547 raft_consensus.cc:2955] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } } }
I20251211 21:05:09.474814 3368 catalog_manager.cc:5654] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 reported cstate change: config changed from index 3 to 4, VOTER e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "206fd4dbe1d84e87a70c3a6caf903718" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92fc789f949a4156ad71247f312d881f" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "206fd4dbe1d84e87a70c3a6caf903718" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252e769aa7314cb686e07846d01becd6" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 39693 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251211 21:05:10.503229 3355 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111) [suppressed 52 similar messages]
W20251211 21:05:10.503906 3355 catalog_manager.cc:4712] TS e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 84a672dde59e4ecdbce8e521a8dcc495: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111)
W20251211 21:05:11.541890 3355 catalog_manager.cc:4712] TS e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 84a672dde59e4ecdbce8e521a8dcc495: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111)
W20251211 21:05:13.597167 3355 catalog_manager.cc:4712] TS e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 84a672dde59e4ecdbce8e521a8dcc495: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111)
I20251211 21:05:14.891644 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:05:14.895112 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:14.895335 30459 tablet_replica.cc:333] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f: stopping tablet replica
I20251211 21:05:14.895462 30459 raft_consensus.cc:2243] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:14.895709 30459 raft_consensus.cc:2272] T 018b85a6951547159823e619bbb09c7c P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.896173 30459 tablet_replica.cc:333] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f: stopping tablet replica
I20251211 21:05:14.896257 30459 raft_consensus.cc:2243] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:14.896360 30459 raft_consensus.cc:2272] T a55ad468620441689f41c441ab8adb1b P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.896656 30459 tablet_replica.cc:333] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f: stopping tablet replica
I20251211 21:05:14.896723 30459 raft_consensus.cc:2243] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:14.896802 30459 raft_consensus.cc:2272] T 84a672dde59e4ecdbce8e521a8dcc495 P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.897060 30459 tablet_replica.cc:333] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f: stopping tablet replica
I20251211 21:05:14.897122 30459 raft_consensus.cc:2243] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:14.897258 30459 raft_consensus.cc:2272] T 366d590ec71240369921263ec2072aca P 92fc789f949a4156ad71247f312d881f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.910372 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:05:14.912983 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:05:14.916714 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:14.916932 30459 tablet_replica.cc:333] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718: stopping tablet replica
I20251211 21:05:14.917062 30459 raft_consensus.cc:2243] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:14.917203 30459 raft_consensus.cc:2272] T 366d590ec71240369921263ec2072aca P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.917624 30459 tablet_replica.cc:333] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718: stopping tablet replica
I20251211 21:05:14.917707 30459 raft_consensus.cc:2243] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:14.917809 30459 raft_consensus.cc:2272] T 018b85a6951547159823e619bbb09c7c P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.918114 30459 tablet_replica.cc:333] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718: stopping tablet replica
I20251211 21:05:14.918187 30459 raft_consensus.cc:2243] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:14.918332 30459 raft_consensus.cc:2272] T 84a672dde59e4ecdbce8e521a8dcc495 P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.918660 30459 tablet_replica.cc:333] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718: stopping tablet replica
I20251211 21:05:14.918763 30459 raft_consensus.cc:2243] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:14.918926 30459 raft_consensus.cc:2272] T a55ad468620441689f41c441ab8adb1b P 206fd4dbe1d84e87a70c3a6caf903718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.932195 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:05:14.934692 30459 tablet_server.cc:178] TabletServer@127.29.190.196:0 shutting down...
I20251211 21:05:14.937896 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:14.938119 30459 tablet_replica.cc:333] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6: stopping tablet replica
I20251211 21:05:14.938242 30459 raft_consensus.cc:2243] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:14.938369 30459 raft_consensus.cc:2272] T 366d590ec71240369921263ec2072aca P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.938791 30459 tablet_replica.cc:333] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6: stopping tablet replica
I20251211 21:05:14.938872 30459 raft_consensus.cc:2243] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:14.938966 30459 raft_consensus.cc:2272] T a55ad468620441689f41c441ab8adb1b P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.939297 30459 tablet_replica.cc:333] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6: stopping tablet replica
I20251211 21:05:14.939385 30459 raft_consensus.cc:2243] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:14.939594 30459 raft_consensus.cc:2272] T 84a672dde59e4ecdbce8e521a8dcc495 P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.939962 30459 tablet_replica.cc:333] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6: stopping tablet replica
I20251211 21:05:14.940043 30459 raft_consensus.cc:2243] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:14.940131 30459 raft_consensus.cc:2272] T 018b85a6951547159823e619bbb09c7c P 252e769aa7314cb686e07846d01becd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:14.952872 30459 tablet_server.cc:195] TabletServer@127.29.190.196:0 shutdown complete.
I20251211 21:05:14.955225 30459 master.cc:561] Master@127.29.190.254:34521 shutting down...
W20251211 21:05:17.695585 3355 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20251211 21:05:17.696352 3355 catalog_manager.cc:4712] TS e9fae2ced70d4387960f261e6366f2c8 (127.29.190.193:36111): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 84a672dde59e4ecdbce8e521a8dcc495: Network error: Client connection negotiation failed: client connection to 127.29.190.193:36111: connect: Connection refused (error 111)
I20251211 21:05:18.549263 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:18.549532 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:18.549618 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4148f597544440588a5a7fc54d1ca549: stopping tablet replica
I20251211 21:05:18.562529 30459 master.cc:583] Master@127.29.190.254:34521 shutdown complete.
[ OK ] AutoRebalancerTest.NoRebalancingIfReplicasRecovering (13296 ms)
[ RUN ] AutoRebalancerTest.TestHandlingFailedTservers
I20251211 21:05:18.570780 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:35687
I20251211 21:05:18.571141 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:18.573148 3838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:18.573154 3837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:18.573357 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:18.573443 3840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:18.573614 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:18.573659 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:18.573679 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487118573679 us; error 0 us; skew 500 ppm
I20251211 21:05:18.574484 30459 webserver.cc:492] Webserver started at http://127.29.190.254:33371/ using document root <none> and password file <none>
I20251211 21:05:18.574623 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:18.574671 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:18.574744 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:18.575132 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "d75cb3047c5542e9aef722de6af748c8"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:18.576541 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:18.577426 3845 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.577637 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:18.577698 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "d75cb3047c5542e9aef722de6af748c8"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:18.577762 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:18.583863 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:18.584175 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:18.587896 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:35687
I20251211 21:05:18.590557 3897 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:35687 every 8 connection(s)
I20251211 21:05:18.591010 3898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:18.592929 3898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8: Bootstrap starting.
I20251211 21:05:18.593685 3898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:18.594652 3898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8: No bootstrap required, opened a new log
I20251211 21:05:18.595031 3898 raft_consensus.cc:359] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d75cb3047c5542e9aef722de6af748c8" member_type: VOTER }
I20251211 21:05:18.595116 3898 raft_consensus.cc:385] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:18.595147 3898 raft_consensus.cc:740] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d75cb3047c5542e9aef722de6af748c8, State: Initialized, Role: FOLLOWER
I20251211 21:05:18.595271 3898 consensus_queue.cc:260] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d75cb3047c5542e9aef722de6af748c8" member_type: VOTER }
I20251211 21:05:18.595350 3898 raft_consensus.cc:399] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:05:18.595391 3898 raft_consensus.cc:493] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:05:18.595436 3898 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:18.596360 3898 raft_consensus.cc:515] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d75cb3047c5542e9aef722de6af748c8" member_type: VOTER }
I20251211 21:05:18.596490 3898 leader_election.cc:304] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d75cb3047c5542e9aef722de6af748c8; no voters:
I20251211 21:05:18.596661 3898 leader_election.cc:290] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:05:18.596791 3901 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:18.596997 3901 raft_consensus.cc:697] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 1 LEADER]: Becoming Leader. State: Replica: d75cb3047c5542e9aef722de6af748c8, State: Running, Role: LEADER
I20251211 21:05:18.597121 3898 sys_catalog.cc:565] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:05:18.597123 3901 consensus_queue.cc:237] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d75cb3047c5542e9aef722de6af748c8" member_type: VOTER }
I20251211 21:05:18.597548 3902 sys_catalog.cc:455] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d75cb3047c5542e9aef722de6af748c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d75cb3047c5542e9aef722de6af748c8" member_type: VOTER } }
I20251211 21:05:18.597584 3903 sys_catalog.cc:455] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d75cb3047c5542e9aef722de6af748c8. Latest consensus state: current_term: 1 leader_uuid: "d75cb3047c5542e9aef722de6af748c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d75cb3047c5542e9aef722de6af748c8" member_type: VOTER } }
I20251211 21:05:18.597636 3902 sys_catalog.cc:458] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [sys.catalog]: This master's current role is: LEADER
I20251211 21:05:18.597676 3903 sys_catalog.cc:458] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [sys.catalog]: This master's current role is: LEADER
I20251211 21:05:18.597903 3906 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:05:18.598706 3906 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:05:18.598928 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:05:18.600466 3906 catalog_manager.cc:1357] Generated new cluster ID: 51b30e67eb9f43d8ae2d78f2334dff33
I20251211 21:05:18.600508 3906 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:05:18.609752 3906 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:05:18.610316 3906 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:05:18.617753 3906 catalog_manager.cc:6027] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8: Generated new TSK 0
I20251211 21:05:18.617924 3906 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:05:18.631330 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:18.633239 3919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:18.633242 3920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:18.633399 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:18.633562 3922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:18.633772 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:18.633816 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:18.633832 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487118633832 us; error 0 us; skew 500 ppm
I20251211 21:05:18.634609 30459 webserver.cc:492] Webserver started at http://127.29.190.193:44483/ using document root <none> and password file <none>
I20251211 21:05:18.634742 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:18.634791 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:18.634863 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:18.635301 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "38c13727bb6a4f0e8e64b9ce16c98e96"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:18.636699 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:18.637530 3927 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.637778 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:18.637858 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "38c13727bb6a4f0e8e64b9ce16c98e96"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:18.637917 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:18.643049 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:18.643352 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:18.643579 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:18.644043 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:18.644079 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.644110 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:18.644138 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.648005 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:41837
I20251211 21:05:18.648027 3990 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:41837 every 8 connection(s)
I20251211 21:05:18.648780 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:18.650440 3996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:18.650547 3998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:18.650453 3995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:18.651082 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:18.651252 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:18.651304 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:18.651324 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487118651323 us; error 0 us; skew 500 ppm
I20251211 21:05:18.652268 30459 webserver.cc:492] Webserver started at http://127.29.190.194:33693/ using document root <none> and password file <none>
I20251211 21:05:18.652419 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:18.652477 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:18.652551 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:18.653040 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:18.653453 3991 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:05:18.653551 3991 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:18.653790 3991 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:05:18.654467 3862 ts_manager.cc:194] Registered new tserver with Master: 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837)
I20251211 21:05:18.654721 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:18.655237 3862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41772
I20251211 21:05:18.655673 4003 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.655947 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:18.656020 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:18.656103 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:18.676222 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:18.676615 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:18.676885 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:18.677366 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:18.677407 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.677439 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:18.677466 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.681476 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:37965
I20251211 21:05:18.681543 4066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:37965 every 8 connection(s)
I20251211 21:05:18.682317 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:18.684095 4070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:18.684116 4071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:18.684244 4073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:18.684482 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:18.684644 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:18.684682 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:18.684702 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487118684701 us; error 0 us; skew 500 ppm
I20251211 21:05:18.685643 30459 webserver.cc:492] Webserver started at http://127.29.190.195:35581/ using document root <none> and password file <none>
I20251211 21:05:18.685791 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:18.685864 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:18.685942 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:18.686324 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "ff6a9feadef141f09b49f4c4365ba458"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:18.686432 4067 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:05:18.686528 4067 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:18.686733 4067 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:05:18.687346 3862 ts_manager.cc:194] Registered new tserver with Master: 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:18.687793 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:18.687955 3862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41780
I20251211 21:05:18.688711 4078 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.688930 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:18.688992 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "ff6a9feadef141f09b49f4c4365ba458"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:18.689057 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:18.694937 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:18.695317 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:18.695583 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:18.696074 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:18.696112 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.696153 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:18.696179 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:18.700627 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:42361
I20251211 21:05:18.700675 4141 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:42361 every 8 connection(s)
I20251211 21:05:18.704903 4142 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:05:18.705020 4142 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:18.705251 4142 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:05:18.705801 3862 ts_manager.cc:194] Registered new tserver with Master: ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:18.706300 3862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41788
I20251211 21:05:18.706590 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00556757s
I20251211 21:05:19.656253 3991 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:05:19.688866 4067 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:05:19.707208 4142 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:05:19.732422 30459 test_util.cc:276] Using random seed: -2136961342
I20251211 21:05:19.739786 3862 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41796:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:05:19.740284 3862 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:05:19.750231 3955 tablet_service.cc:1505] Processing CreateTablet for tablet c837acd9ae7d4c6c8ceade5c374ca951 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:19.750406 3954 tablet_service.cc:1505] Processing CreateTablet for tablet 1b1938b2edaa4476bf97e2d7d01a9023 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:19.750586 3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c837acd9ae7d4c6c8ceade5c374ca951. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.750849 3953 tablet_service.cc:1505] Processing CreateTablet for tablet ada11cb3f80445579a01d43201cf153e (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:19.751099 3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada11cb3f80445579a01d43201cf153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.752707 4162 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap starting.
I20251211 21:05:19.752993 3952 tablet_service.cc:1505] Processing CreateTablet for tablet 9ac5dc6ea86a4041bff5c47e92102e53 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:19.753232 3952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac5dc6ea86a4041bff5c47e92102e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.753690 4162 tablet_bootstrap.cc:654] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.754801 4162 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: No bootstrap required, opened a new log
I20251211 21:05:19.754909 4162 ts_tablet_manager.cc:1403] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:19.755148 3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1938b2edaa4476bf97e2d7d01a9023. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.755350 4162 raft_consensus.cc:359] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.755461 4162 raft_consensus.cc:385] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.755493 4162 raft_consensus.cc:740] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.755635 4162 consensus_queue.cc:260] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.756001 4162 ts_tablet_manager.cc:1434] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:19.756177 4162 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap starting.
I20251211 21:05:19.757143 4162 tablet_bootstrap.cc:654] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.758260 4105 tablet_service.cc:1505] Processing CreateTablet for tablet 1b1938b2edaa4476bf97e2d7d01a9023 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:19.758358 4104 tablet_service.cc:1505] Processing CreateTablet for tablet ada11cb3f80445579a01d43201cf153e (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:19.758471 4103 tablet_service.cc:1505] Processing CreateTablet for tablet 9ac5dc6ea86a4041bff5c47e92102e53 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:19.758553 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1938b2edaa4476bf97e2d7d01a9023. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.758661 4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada11cb3f80445579a01d43201cf153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.758260 4106 tablet_service.cc:1505] Processing CreateTablet for tablet c837acd9ae7d4c6c8ceade5c374ca951 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:19.759039 4106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c837acd9ae7d4c6c8ceade5c374ca951. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.759155 4030 tablet_service.cc:1505] Processing CreateTablet for tablet c837acd9ae7d4c6c8ceade5c374ca951 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:19.759384 4030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c837acd9ae7d4c6c8ceade5c374ca951. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.759701 4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac5dc6ea86a4041bff5c47e92102e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.761315 4162 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: No bootstrap required, opened a new log
I20251211 21:05:19.761409 4167 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap starting.
I20251211 21:05:19.761462 4162 ts_tablet_manager.cc:1403] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251211 21:05:19.761813 4026 tablet_service.cc:1505] Processing CreateTablet for tablet ada11cb3f80445579a01d43201cf153e (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:19.762043 4026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada11cb3f80445579a01d43201cf153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.762099 4162 raft_consensus.cc:359] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.762192 4162 raft_consensus.cc:385] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.762223 4162 raft_consensus.cc:740] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.762372 4162 consensus_queue.cc:260] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.762494 4167 tablet_bootstrap.cc:654] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.762683 4162 ts_tablet_manager.cc:1434] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:19.762854 4162 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap starting.
I20251211 21:05:19.763152 4166 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap starting.
I20251211 21:05:19.763773 4162 tablet_bootstrap.cc:654] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.763959 4166 tablet_bootstrap.cc:654] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.763918 4029 tablet_service.cc:1505] Processing CreateTablet for tablet 9ac5dc6ea86a4041bff5c47e92102e53 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:19.764163 4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac5dc6ea86a4041bff5c47e92102e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.764760 4162 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: No bootstrap required, opened a new log
I20251211 21:05:19.764822 4162 ts_tablet_manager.cc:1403] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:05:19.764986 4166 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: No bootstrap required, opened a new log
I20251211 21:05:19.765064 4166 ts_tablet_manager.cc:1403] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:05:19.765149 4162 raft_consensus.cc:359] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.765221 4162 raft_consensus.cc:385] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.765241 4162 raft_consensus.cc:740] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.765338 4162 consensus_queue.cc:260] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.765443 4166 raft_consensus.cc:359] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.765532 4166 raft_consensus.cc:385] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.765558 4162 ts_tablet_manager.cc:1434] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:19.765559 4166 raft_consensus.cc:740] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.765698 4162 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap starting.
I20251211 21:05:19.765723 4166 consensus_queue.cc:260] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.766063 4166 ts_tablet_manager.cc:1434] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:19.766232 4166 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Bootstrap starting.
I20251211 21:05:19.761536 4031 tablet_service.cc:1505] Processing CreateTablet for tablet 1b1938b2edaa4476bf97e2d7d01a9023 (DEFAULT_TABLE table=test-workload [id=4525c1a083eb4e35b43df114d343196e]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:19.766521 4162 tablet_bootstrap.cc:654] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.766649 4031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1938b2edaa4476bf97e2d7d01a9023. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:19.767249 4166 tablet_bootstrap.cc:654] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.767908 4162 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: No bootstrap required, opened a new log
I20251211 21:05:19.768043 4162 ts_tablet_manager.cc:1403] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:05:19.768393 4162 raft_consensus.cc:359] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.768479 4162 raft_consensus.cc:385] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.768508 4162 raft_consensus.cc:740] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.768635 4162 consensus_queue.cc:260] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.769057 4162 ts_tablet_manager.cc:1434] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:19.769203 4166 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: No bootstrap required, opened a new log
I20251211 21:05:19.769297 4166 ts_tablet_manager.cc:1403] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:05:19.769773 4167 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: No bootstrap required, opened a new log
I20251211 21:05:19.769852 4167 ts_tablet_manager.cc:1403] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251211 21:05:19.770229 4167 raft_consensus.cc:359] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.770326 4167 raft_consensus.cc:385] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.770360 4167 raft_consensus.cc:740] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.770459 4167 consensus_queue.cc:260] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.770532 4166 raft_consensus.cc:359] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.770637 4166 raft_consensus.cc:385] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.770677 4166 raft_consensus.cc:740] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.770787 4167 ts_tablet_manager.cc:1434] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:19.770797 4166 consensus_queue.cc:260] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.770982 4167 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap starting.
I20251211 21:05:19.771378 4166 ts_tablet_manager.cc:1434] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:05:19.771557 4166 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap starting.
I20251211 21:05:19.771963 4167 tablet_bootstrap.cc:654] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.772660 4166 tablet_bootstrap.cc:654] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.773262 4167 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: No bootstrap required, opened a new log
I20251211 21:05:19.773360 4167 ts_tablet_manager.cc:1403] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:19.773784 4167 raft_consensus.cc:359] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.773895 4167 raft_consensus.cc:385] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.773931 4167 raft_consensus.cc:740] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.774044 4167 consensus_queue.cc:260] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.774266 4167 ts_tablet_manager.cc:1434] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:19.774428 4167 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap starting.
I20251211 21:05:19.775281 4167 tablet_bootstrap.cc:654] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.776325 4167 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: No bootstrap required, opened a new log
I20251211 21:05:19.776404 4167 ts_tablet_manager.cc:1403] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:05:19.776746 4167 raft_consensus.cc:359] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.776834 4167 raft_consensus.cc:385] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.776862 4167 raft_consensus.cc:740] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.776973 4167 consensus_queue.cc:260] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.777184 4167 ts_tablet_manager.cc:1434] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:19.777352 4167 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap starting.
I20251211 21:05:19.778286 4167 tablet_bootstrap.cc:654] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.779196 4166 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: No bootstrap required, opened a new log
I20251211 21:05:19.779282 4166 ts_tablet_manager.cc:1403] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251211 21:05:19.779703 4166 raft_consensus.cc:359] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.779778 4167 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: No bootstrap required, opened a new log
I20251211 21:05:19.779791 4166 raft_consensus.cc:385] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.779876 4166 raft_consensus.cc:740] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.779909 4167 ts_tablet_manager.cc:1403] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:19.779994 4166 consensus_queue.cc:260] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.780225 4166 ts_tablet_manager.cc:1434] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:19.780328 4167 raft_consensus.cc:359] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.780419 4167 raft_consensus.cc:385] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.780431 4166 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap starting.
I20251211 21:05:19.780481 4167 raft_consensus.cc:740] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.780622 4167 consensus_queue.cc:260] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.780915 4167 ts_tablet_manager.cc:1434] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:19.781893 4166 tablet_bootstrap.cc:654] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:19.782894 4166 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: No bootstrap required, opened a new log
I20251211 21:05:19.782985 4166 ts_tablet_manager.cc:1403] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:05:19.783339 4166 raft_consensus.cc:359] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.783420 4166 raft_consensus.cc:385] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:19.783449 4166 raft_consensus.cc:740] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Initialized, Role: FOLLOWER
I20251211 21:05:19.783576 4166 consensus_queue.cc:260] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.783859 4166 ts_tablet_manager.cc:1434] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:19.815568 4164 raft_consensus.cc:493] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:19.815743 4164 raft_consensus.cc:515] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.816228 4164 leader_election.cc:290] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:19.820487 4041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c837acd9ae7d4c6c8ceade5c374ca951" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" is_pre_election: true
I20251211 21:05:19.820487 4116 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c837acd9ae7d4c6c8ceade5c374ca951" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458" is_pre_election: true
I20251211 21:05:19.820693 4041 raft_consensus.cc:2468] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 0.
I20251211 21:05:19.820693 4116 raft_consensus.cc:2468] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 0.
I20251211 21:05:19.821009 3928 leader_election.cc:304] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:19.821175 4164 raft_consensus.cc:2804] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:19.821237 4164 raft_consensus.cc:493] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:19.821283 4164 raft_consensus.cc:3060] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:19.822104 4164 raft_consensus.cc:515] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.822427 4164 leader_election.cc:290] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 1 election: Requested vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:19.822738 4041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c837acd9ae7d4c6c8ceade5c374ca951" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
I20251211 21:05:19.822839 4041 raft_consensus.cc:3060] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:19.822809 4116 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c837acd9ae7d4c6c8ceade5c374ca951" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458"
I20251211 21:05:19.822968 4116 raft_consensus.cc:3060] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:19.823684 4041 raft_consensus.cc:2468] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 1.
I20251211 21:05:19.823827 4116 raft_consensus.cc:2468] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 1.
I20251211 21:05:19.823923 3928 leader_election.cc:304] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, 64a4a1a9596c4c51a460c1d35d6d77d5; no voters:
I20251211 21:05:19.824165 4164 raft_consensus.cc:2804] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:19.824368 4164 raft_consensus.cc:697] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 LEADER]: Becoming Leader. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Running, Role: LEADER
I20251211 21:05:19.824512 4164 consensus_queue.cc:237] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.825937 3862 catalog_manager.cc:5654] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193). New cstate: current_term: 1 leader_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: UNKNOWN } } }
W20251211 21:05:19.899672 3992 tablet.cc:2378] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 21:05:19.899765 4164 raft_consensus.cc:493] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:19.899906 4164 raft_consensus.cc:515] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.900318 4164 leader_election.cc:290] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:19.900755 4041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" is_pre_election: true
I20251211 21:05:19.900774 4116 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458" is_pre_election: true
I20251211 21:05:19.900880 4041 raft_consensus.cc:2468] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 0.
I20251211 21:05:19.900913 4116 raft_consensus.cc:2468] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 0.
I20251211 21:05:19.901149 3928 leader_election.cc:304] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:19.901307 4164 raft_consensus.cc:2804] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:19.901356 4164 raft_consensus.cc:493] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:19.901398 4164 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:19.902227 4164 raft_consensus.cc:515] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.902532 4164 leader_election.cc:290] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 1 election: Requested vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:19.902822 4041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
I20251211 21:05:19.902880 4116 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458"
I20251211 21:05:19.902913 4041 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:19.902988 4116 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:19.903750 4116 raft_consensus.cc:2468] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 1.
I20251211 21:05:19.903756 4041 raft_consensus.cc:2468] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 1.
I20251211 21:05:19.904031 3928 leader_election.cc:304] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, 64a4a1a9596c4c51a460c1d35d6d77d5; no voters:
I20251211 21:05:19.904181 4164 raft_consensus.cc:2804] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:19.904265 4164 raft_consensus.cc:697] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 LEADER]: Becoming Leader. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Running, Role: LEADER
I20251211 21:05:19.904392 4164 consensus_queue.cc:237] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:19.905857 3862 catalog_manager.cc:5654] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193). New cstate: current_term: 1 leader_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:20.042194 4174 raft_consensus.cc:493] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:20.042348 4174 raft_consensus.cc:515] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:20.042876 4174 leader_election.cc:290] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:20.046330 3965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" is_pre_election: true
I20251211 21:05:20.046505 3965 raft_consensus.cc:2468] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64a4a1a9596c4c51a460c1d35d6d77d5 in term 0.
I20251211 21:05:20.046515 4116 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458" is_pre_election: true
I20251211 21:05:20.046626 4116 raft_consensus.cc:2468] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64a4a1a9596c4c51a460c1d35d6d77d5 in term 0.
I20251211 21:05:20.046834 4004 leader_election.cc:304] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, 64a4a1a9596c4c51a460c1d35d6d77d5; no voters:
I20251211 21:05:20.046993 4174 raft_consensus.cc:2804] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:20.047057 4174 raft_consensus.cc:493] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:20.047104 4174 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:20.047943 4174 raft_consensus.cc:515] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:20.048264 4174 leader_election.cc:290] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [CANDIDATE]: Term 1 election: Requested vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:20.048566 3965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96"
I20251211 21:05:20.048581 4116 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458"
I20251211 21:05:20.048692 3965 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:20.048707 4116 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:20.049590 3965 raft_consensus.cc:2468] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64a4a1a9596c4c51a460c1d35d6d77d5 in term 1.
I20251211 21:05:20.049590 4116 raft_consensus.cc:2468] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64a4a1a9596c4c51a460c1d35d6d77d5 in term 1.
I20251211 21:05:20.049896 4004 leader_election.cc:304] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:20.050068 4174 raft_consensus.cc:2804] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:20.050268 4174 raft_consensus.cc:697] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 LEADER]: Becoming Leader. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Running, Role: LEADER
I20251211 21:05:20.050406 4174 consensus_queue.cc:237] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:20.052014 3862 catalog_manager.cc:5654] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194). New cstate: current_term: 1 leader_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:20.055523 4171 raft_consensus.cc:493] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:20.055649 4171 raft_consensus.cc:515] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:20.056061 4171 leader_election.cc:290] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:20.059564 4041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ac5dc6ea86a4041bff5c47e92102e53" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" is_pre_election: true
I20251211 21:05:20.059582 3965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ac5dc6ea86a4041bff5c47e92102e53" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" is_pre_election: true
I20251211 21:05:20.059719 4041 raft_consensus.cc:2468] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 0.
I20251211 21:05:20.059744 3965 raft_consensus.cc:2468] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 0.
I20251211 21:05:20.059973 4079 leader_election.cc:304] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:20.060135 4171 raft_consensus.cc:2804] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:20.060187 4171 raft_consensus.cc:493] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:20.060231 4171 raft_consensus.cc:3060] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:20.061048 4171 raft_consensus.cc:515] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:20.061357 4171 leader_election.cc:290] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 1 election: Requested vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:20.061659 3965 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ac5dc6ea86a4041bff5c47e92102e53" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96"
I20251211 21:05:20.061676 4041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ac5dc6ea86a4041bff5c47e92102e53" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
I20251211 21:05:20.061751 3965 raft_consensus.cc:3060] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:20.061757 4041 raft_consensus.cc:3060] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:20.062475 3965 raft_consensus.cc:2468] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 1.
I20251211 21:05:20.062493 4041 raft_consensus.cc:2468] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 1.
I20251211 21:05:20.062723 4079 leader_election.cc:304] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:20.062889 4171 raft_consensus.cc:2804] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:20.063122 4171 raft_consensus.cc:697] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 LEADER]: Becoming Leader. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Running, Role: LEADER
I20251211 21:05:20.063261 4171 consensus_queue.cc:237] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:20.064818 3862 catalog_manager.cc:5654] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195). New cstate: current_term: 1 leader_uuid: "ff6a9feadef141f09b49f4c4365ba458" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:20.122443 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:05:20.125751 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:20.126022 30459 tablet_replica.cc:333] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: stopping tablet replica
I20251211 21:05:20.126148 30459 raft_consensus.cc:2243] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:20.126269 30459 raft_consensus.cc:2272] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.126760 30459 tablet_replica.cc:333] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: stopping tablet replica
I20251211 21:05:20.126866 30459 raft_consensus.cc:2243] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:20.126957 30459 raft_consensus.cc:2272] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.127338 30459 tablet_replica.cc:333] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: stopping tablet replica
I20251211 21:05:20.127447 30459 raft_consensus.cc:2243] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:20.127573 30459 pending_rounds.cc:70] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Trying to abort 1 pending ops.
I20251211 21:05:20.127629 30459 pending_rounds.cc:77] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231435242802737152 op_type: NO_OP noop_request { }
I20251211 21:05:20.127708 30459 raft_consensus.cc:2889] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:05:20.127767 30459 raft_consensus.cc:2272] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.128243 30459 tablet_replica.cc:333] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: stopping tablet replica
I20251211 21:05:20.128322 30459 raft_consensus.cc:2243] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:20.128432 30459 pending_rounds.cc:70] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Trying to abort 1 pending ops.
I20251211 21:05:20.128458 30459 pending_rounds.cc:77] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231435243129786368 op_type: NO_OP noop_request { }
I20251211 21:05:20.128515 30459 raft_consensus.cc:2889] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:05:20.128567 30459 raft_consensus.cc:2272] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.141831 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:05:20.144095 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:05:20.147574 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:20.147859 30459 tablet_replica.cc:333] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: stopping tablet replica
I20251211 21:05:20.147974 30459 raft_consensus.cc:2243] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:20.148118 30459 pending_rounds.cc:70] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Trying to abort 1 pending ops.
I20251211 21:05:20.148142 30459 pending_rounds.cc:77] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231435243727814656 op_type: NO_OP noop_request { }
I20251211 21:05:20.148203 30459 raft_consensus.cc:2889] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:05:20.148245 30459 raft_consensus.cc:2272] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.148815 30459 tablet_replica.cc:333] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: stopping tablet replica
I20251211 21:05:20.148903 30459 raft_consensus.cc:2243] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:20.148977 30459 raft_consensus.cc:2272] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.149295 30459 tablet_replica.cc:333] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: stopping tablet replica
I20251211 21:05:20.149363 30459 raft_consensus.cc:2243] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:20.149425 30459 raft_consensus.cc:2272] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.149766 30459 tablet_replica.cc:333] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: stopping tablet replica
I20251211 21:05:20.149844 30459 raft_consensus.cc:2243] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:20.149909 30459 raft_consensus.cc:2272] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.152545 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:05:20.154430 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:05:20.157881 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:20.158108 30459 tablet_replica.cc:333] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: stopping tablet replica
I20251211 21:05:20.158227 30459 raft_consensus.cc:2243] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:20.158337 30459 raft_consensus.cc:2272] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.158774 30459 tablet_replica.cc:333] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: stopping tablet replica
I20251211 21:05:20.158864 30459 raft_consensus.cc:2243] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:20.158998 30459 pending_rounds.cc:70] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Trying to abort 1 pending ops.
I20251211 21:05:20.159027 30459 pending_rounds.cc:77] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231435243780689920 op_type: NO_OP noop_request { }
I20251211 21:05:20.159109 30459 raft_consensus.cc:2889] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:05:20.159165 30459 raft_consensus.cc:2272] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.159744 30459 tablet_replica.cc:333] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: stopping tablet replica
I20251211 21:05:20.159827 30459 raft_consensus.cc:2243] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:20.159915 30459 raft_consensus.cc:2272] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.160269 30459 tablet_replica.cc:333] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: stopping tablet replica
I20251211 21:05:20.160351 30459 raft_consensus.cc:2243] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:20.160431 30459 raft_consensus.cc:2272] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:20.163082 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:05:20.165465 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:20.167090 4194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:20.167233 4193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:20.167258 4196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:20.167465 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:20.167709 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:20.167758 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:20.167776 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487120167776 us; error 0 us; skew 500 ppm
I20251211 21:05:20.168556 30459 webserver.cc:492] Webserver started at http://127.29.190.196:33627/ using document root <none> and password file <none>
I20251211 21:05:20.168684 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:20.168730 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:20.168802 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:20.169155 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-3-root/instance:
uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709"
format_stamp: "Formatted at 2025-12-11 21:05:20 on dist-test-slave-xjj2"
I20251211 21:05:20.170532 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:20.171449 4201 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:20.171747 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:20.171823 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-3-root
uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709"
format_stamp: "Formatted at 2025-12-11 21:05:20 on dist-test-slave-xjj2"
I20251211 21:05:20.171904 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:20.181747 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:20.182140 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:20.182430 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:20.182881 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:20.182925 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:20.182973 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:20.183001 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:20.186769 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.196:44557
I20251211 21:05:20.188848 4264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.196:44557 every 8 connection(s)
I20251211 21:05:20.193122 4265 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:05:20.193236 4265 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:20.193444 4265 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:05:20.194002 3862 ts_manager.cc:194] Registered new tserver with Master: 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196:44557)
I20251211 21:05:20.194507 3862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41806
W20251211 21:05:20.600992 3911 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.29.190.195:42361: connect: Connection refused (error 111)
W20251211 21:05:20.602313 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.195:42361: connect: Connection refused (error 111)
W20251211 21:05:20.602387 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.195:42361: connect: Connection refused (error 111)
W20251211 21:05:20.603294 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:20.603354 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:20.604234 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.194:37965: connect: Connection refused (error 111)
W20251211 21:05:20.604290 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.194:37965: connect: Connection refused (error 111)
I20251211 21:05:21.195366 4265 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
W20251211 21:05:21.605708 3911 auto_rebalancer.cc:249] could not retrieve auto-rebalancing replica moves: Not found: table 4525c1a083eb4e35b43df114d343196e: could not find any suitable replica to move from server 38c13727bb6a4f0e8e64b9ce16c98e96 to server 40b9f3c96e0d40ffa2d9449d3ba7a709
W20251211 21:05:22.608340 3911 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.29.190.195:42361: connect: Connection refused (error 111)
W20251211 21:05:22.609781 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.195:42361: connect: Connection refused (error 111)
W20251211 21:05:22.609848 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.195:42361: connect: Connection refused (error 111)
W20251211 21:05:22.611013 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:22.611076 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:22.612056 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.194:37965: connect: Connection refused (error 111)
W20251211 21:05:22.612107 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.194:37965: connect: Connection refused (error 111)
W20251211 21:05:23.614585 3911 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:23.615420 3846 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20251211 21:05:23.616166 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:23.616220 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:23.617199 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:23.617245 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:23.618228 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.195:42361: connect: Connection refused (error 111)
W20251211 21:05:23.618281 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.195:42361: connect: Connection refused (error 111)
W20251211 21:05:24.620779 3911 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.29.190.194:37965: connect: Connection refused (error 111)
W20251211 21:05:24.622212 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.194:37965: connect: Connection refused (error 111)
W20251211 21:05:24.622278 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.194:37965: connect: Connection refused (error 111)
W20251211 21:05:24.623205 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:24.623263 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:24.624202 3911 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:24.624255 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.29.190.193:41837: connect: Connection refused (error 111)
W20251211 21:05:25.624816 3911 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver 38c13727bb6a4f0e8e64b9ce16c98e96 not available for placement
I20251211 21:05:25.701772 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:25.703862 4280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:25.704041 4283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:25.704080 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:25.704079 4281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:25.704420 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:25.704463 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:25.704484 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487125704484 us; error 0 us; skew 500 ppm
I20251211 21:05:25.705360 30459 webserver.cc:492] Webserver started at http://127.29.190.193:44483/ using document root <none> and password file <none>
I20251211 21:05:25.705505 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:25.705542 30459 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 21:05:25.706543 30459 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:25.707499 4288 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:25.707751 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:25.707810 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "38c13727bb6a4f0e8e64b9ce16c98e96"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:25.707878 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:25.735081 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:25.735540 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:25.735852 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:25.736582 4295 ts_tablet_manager.cc:542] Loading tablet metadata (0/4 complete)
I20251211 21:05:25.739712 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (4 total tablets, 4 live tablets)
I20251211 21:05:25.739777 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20251211 21:05:25.739832 30459 ts_tablet_manager.cc:600] Registering tablets (0/4 complete)
I20251211 21:05:25.740703 4295 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap starting.
I20251211 21:05:25.741784 30459 ts_tablet_manager.cc:616] Registered 4 tablets
I20251211 21:05:25.741832 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251211 21:05:25.743362 4295 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 21:05:25.743680 4295 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap complete.
I20251211 21:05:25.743901 4295 ts_tablet_manager.cc:1403] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20251211 21:05:25.744279 4295 raft_consensus.cc:359] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.744413 4295 raft_consensus.cc:740] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.744556 4295 consensus_queue.cc:260] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.744902 4295 ts_tablet_manager.cc:1434] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:25.745091 4295 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap starting.
I20251211 21:05:25.746697 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:41837
I20251211 21:05:25.747392 4355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:41837 every 8 connection(s)
I20251211 21:05:25.747560 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:05:25.748314 4295 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 21:05:25.748597 4295 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap complete.
I20251211 21:05:25.748759 4295 ts_tablet_manager.cc:1403] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20251211 21:05:25.749364 4295 raft_consensus.cc:359] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.749509 4295 raft_consensus.cc:740] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.749630 4295 consensus_queue.cc:260] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
W20251211 21:05:25.749783 4363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:25.749799 4360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:25.749910 4295 ts_tablet_manager.cc:1434] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:25.750087 4295 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap starting.
I20251211 21:05:25.752640 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:25.752657 4361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:25.752722 4295 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:25.752878 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251211 21:05:25.752908 4295 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap complete.
W20251211 21:05:25.752938 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:25.752969 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487125752969 us; error 0 us; skew 500 ppm
I20251211 21:05:25.753074 4295 ts_tablet_manager.cc:1403] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:25.753440 4295 raft_consensus.cc:359] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.753535 4295 raft_consensus.cc:740] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.753677 4295 consensus_queue.cc:260] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.753890 30459 webserver.cc:492] Webserver started at http://127.29.190.194:33693/ using document root <none> and password file <none>
I20251211 21:05:25.753917 4295 ts_tablet_manager.cc:1434] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:25.754047 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:25.754113 30459 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 21:05:25.754060 4295 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap starting.
I20251211 21:05:25.755048 30459 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:25.755551 4356 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:05:25.755676 4356 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:25.755927 4356 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:05:25.756243 4370 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:25.756402 4295 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:25.756620 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:25.756628 4295 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Bootstrap complete.
I20251211 21:05:25.756702 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:25.756770 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:25.756831 4295 ts_tablet_manager.cc:1403] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:25.756897 3862 ts_manager.cc:194] Re-registered known tserver with Master: 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837)
I20251211 21:05:25.757196 4295 raft_consensus.cc:359] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.757299 4295 raft_consensus.cc:740] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.757427 4295 consensus_queue.cc:260] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.757690 4295 ts_tablet_manager.cc:1434] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:25.758030 3862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48786
I20251211 21:05:25.758711 4356 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:05:25.778831 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:25.779278 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:25.779564 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:25.783277 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (4 total tablets, 4 live tablets)
I20251211 21:05:25.783363 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20251211 21:05:25.784247 4377 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap starting.
I20251211 21:05:25.785377 30459 ts_tablet_manager.cc:616] Registered 4 tablets
I20251211 21:05:25.785429 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251211 21:05:25.786765 4377 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:25.786998 4377 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap complete.
I20251211 21:05:25.787159 4377 ts_tablet_manager.cc:1403] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:25.787544 4377 raft_consensus.cc:359] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.787681 4377 raft_consensus.cc:740] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.787824 4377 consensus_queue.cc:260] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.788179 4377 ts_tablet_manager.cc:1434] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:25.788349 4377 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap starting.
I20251211 21:05:25.790517 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:37965
I20251211 21:05:25.790580 4437 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:37965 every 8 connection(s)
I20251211 21:05:25.790773 4377 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:25.791018 4377 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap complete.
I20251211 21:05:25.791179 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:05:25.791206 4377 ts_tablet_manager.cc:1403] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:25.791739 4377 raft_consensus.cc:359] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.791847 4377 raft_consensus.cc:740] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.791988 4377 consensus_queue.cc:260] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.792251 4377 ts_tablet_manager.cc:1434] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:25.792500 4377 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap starting.
W20251211 21:05:25.792883 4441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:25.792996 4442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:25.795279 4377 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20251211 21:05:25.795475 4444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:25.795570 4377 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap complete.
I20251211 21:05:25.795809 4377 ts_tablet_manager.cc:1403] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20251211 21:05:25.795809 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:25.796049 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:25.796106 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:25.796130 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487125796129 us; error 0 us; skew 500 ppm
I20251211 21:05:25.796247 4377 raft_consensus.cc:359] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.796375 4377 raft_consensus.cc:740] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.796512 4377 consensus_queue.cc:260] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.796772 4377 ts_tablet_manager.cc:1434] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:25.796927 4377 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap starting.
I20251211 21:05:25.798063 30459 webserver.cc:492] Webserver started at http://127.29.190.195:35581/ using document root <none> and password file <none>
I20251211 21:05:25.798198 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:25.798238 30459 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 21:05:25.798980 4438 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:05:25.799077 4438 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:25.799300 4438 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:05:25.799528 4377 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:25.799779 4377 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Bootstrap complete.
I20251211 21:05:25.799923 30459 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:25.799937 4377 ts_tablet_manager.cc:1403] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251211 21:05:25.800280 3862 ts_manager.cc:194] Re-registered known tserver with Master: 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:25.800376 4377 raft_consensus.cc:359] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.800475 4377 raft_consensus.cc:740] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.800643 4377 consensus_queue.cc:260] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.800980 4377 ts_tablet_manager.cc:1434] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:25.801199 4451 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:25.801415 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:25.801477 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "ff6a9feadef141f09b49f4c4365ba458"
format_stamp: "Formatted at 2025-12-11 21:05:18 on dist-test-slave-xjj2"
I20251211 21:05:25.801539 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:25.801577 3862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48794
I20251211 21:05:25.802279 4438 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:05:25.815353 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:25.815862 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:25.816174 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:25.819675 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (4 total tablets, 4 live tablets)
I20251211 21:05:25.819757 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20251211 21:05:25.820513 4458 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap starting.
I20251211 21:05:25.821599 30459 ts_tablet_manager.cc:616] Registered 4 tablets
I20251211 21:05:25.821645 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251211 21:05:25.822839 4458 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:25.823058 4458 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap complete.
I20251211 21:05:25.823235 4458 ts_tablet_manager.cc:1403] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20251211 21:05:25.823720 4458 raft_consensus.cc:359] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.823837 4458 raft_consensus.cc:740] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.823978 4458 consensus_queue.cc:260] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.824324 4458 ts_tablet_manager.cc:1434] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:25.824470 4458 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Bootstrap starting.
I20251211 21:05:25.826512 4458 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:25.826701 4458 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Bootstrap complete.
I20251211 21:05:25.826855 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:42361
I20251211 21:05:25.826865 4458 ts_tablet_manager.cc:1403] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:25.827311 4458 raft_consensus.cc:359] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.827431 4458 raft_consensus.cc:740] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.827569 4458 consensus_queue.cc:260] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.826902 4518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:42361 every 8 connection(s)
I20251211 21:05:25.827927 4458 ts_tablet_manager.cc:1434] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:25.828095 4458 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap starting.
I20251211 21:05:25.830404 4458 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:25.830613 4458 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap complete.
I20251211 21:05:25.830780 4458 ts_tablet_manager.cc:1403] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:25.831219 4458 raft_consensus.cc:359] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.831338 4458 raft_consensus.cc:740] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.831481 4458 consensus_queue.cc:260] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.831808 4458 ts_tablet_manager.cc:1434] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:25.831809 4519 heartbeater.cc:344] Connected to a master server at 127.29.190.254:35687
I20251211 21:05:25.831945 4519 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:25.831990 4458 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap starting.
I20251211 21:05:25.832195 4519 heartbeater.cc:507] Master 127.29.190.254:35687 requested a full tablet report, sending...
I20251211 21:05:25.833117 3862 ts_manager.cc:194] Re-registered known tserver with Master: ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:25.834429 3862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48798
I20251211 21:05:25.834874 4458 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 21:05:25.835134 4458 tablet_bootstrap.cc:492] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Bootstrap complete.
I20251211 21:05:25.835213 4519 heartbeater.cc:499] Master 127.29.190.254:35687 was elected leader, sending a full tablet report...
I20251211 21:05:25.835279 4458 ts_tablet_manager.cc:1403] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:25.835705 4458 raft_consensus.cc:359] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.835852 4458 raft_consensus.cc:740] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Initialized, Role: FOLLOWER
I20251211 21:05:25.835996 4458 consensus_queue.cc:260] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:25.836227 4458 ts_tablet_manager.cc:1434] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251211 21:05:26.631076 3911 auto_rebalancer.cc:253] failed to send replica move request: Illegal state: Replica 64a4a1a9596c4c51a460c1d35d6d77d5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } }
W20251211 21:05:26.632241 3911 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 1b1938b2edaa4476bf97e2d7d01a9023, TS 38c13727bb6a4f0e8e64b9ce16c98e96 -> TS 40b9f3c96e0d40ffa2d9449d3ba7a709 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
W20251211 21:05:26.632313 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 1b1938b2edaa4476bf97e2d7d01a9023, TS 38c13727bb6a4f0e8e64b9ce16c98e96 -> TS 40b9f3c96e0d40ffa2d9449d3ba7a709 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
W20251211 21:05:26.636297 3911 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ada11cb3f80445579a01d43201cf153e, TS ff6a9feadef141f09b49f4c4365ba458 -> TS 40b9f3c96e0d40ffa2d9449d3ba7a709 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
W20251211 21:05:26.636370 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet ada11cb3f80445579a01d43201cf153e, TS ff6a9feadef141f09b49f4c4365ba458 -> TS 40b9f3c96e0d40ffa2d9449d3ba7a709 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
W20251211 21:05:26.640324 3911 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9ac5dc6ea86a4041bff5c47e92102e53, TS 64a4a1a9596c4c51a460c1d35d6d77d5 -> TS 40b9f3c96e0d40ffa2d9449d3ba7a709 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
W20251211 21:05:26.640403 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 9ac5dc6ea86a4041bff5c47e92102e53, TS 64a4a1a9596c4c51a460c1d35d6d77d5 -> TS 40b9f3c96e0d40ffa2d9449d3ba7a709 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:26.920037 4528 raft_consensus.cc:493] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:26.920181 4528 raft_consensus.cc:515] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:26.920737 4528 leader_election.cc:290] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:26.924240 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" is_pre_election: true
I20251211 21:05:26.924291 4492 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458" is_pre_election: true
I20251211 21:05:26.924413 4411 raft_consensus.cc:2410] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 38c13727bb6a4f0e8e64b9ce16c98e96 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251211 21:05:26.924419 4492 raft_consensus.cc:2468] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 1.
I20251211 21:05:26.924746 4289 leader_election.cc:304] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:26.924911 4528 raft_consensus.cc:2804] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 21:05:26.924962 4528 raft_consensus.cc:493] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:26.924989 4528 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:26.925835 4528 raft_consensus.cc:515] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:26.926157 4528 leader_election.cc:290] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 2 election: Requested vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:26.926455 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
I20251211 21:05:26.926487 4492 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458"
I20251211 21:05:26.926568 4411 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:26.926573 4492 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:26.927507 4492 raft_consensus.cc:2468] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 2.
I20251211 21:05:26.927553 4411 raft_consensus.cc:2410] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 38c13727bb6a4f0e8e64b9ce16c98e96 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251211 21:05:26.927809 4289 leader_election.cc:304] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:26.927951 4528 raft_consensus.cc:2804] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:05:26.928149 4528 raft_consensus.cc:697] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 LEADER]: Becoming Leader. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Running, Role: LEADER
I20251211 21:05:26.928284 4528 consensus_queue.cc:237] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:26.929672 3862 catalog_manager.cc:5654] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 reported cstate change: term changed from 1 to 2, leader changed from 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194) to 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193). New cstate: current_term: 2 leader_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:27.106377 4528 raft_consensus.cc:493] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:27.106534 4528 raft_consensus.cc:515] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.106914 4528 leader_election.cc:290] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:27.107399 4492 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c837acd9ae7d4c6c8ceade5c374ca951" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458" is_pre_election: true
I20251211 21:05:27.107370 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c837acd9ae7d4c6c8ceade5c374ca951" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" is_pre_election: true
I20251211 21:05:27.107545 4492 raft_consensus.cc:2468] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 1.
I20251211 21:05:27.107553 4411 raft_consensus.cc:2468] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 1.
I20251211 21:05:27.107854 4289 leader_election.cc:304] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:27.108019 4528 raft_consensus.cc:2804] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 21:05:27.108070 4528 raft_consensus.cc:493] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:27.108114 4528 raft_consensus.cc:3060] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.109001 4528 raft_consensus.cc:515] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.109288 4528 leader_election.cc:290] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 2 election: Requested vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:27.109572 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c837acd9ae7d4c6c8ceade5c374ca951" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
I20251211 21:05:27.109655 4411 raft_consensus.cc:3060] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.109632 4492 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c837acd9ae7d4c6c8ceade5c374ca951" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458"
I20251211 21:05:27.109746 4492 raft_consensus.cc:3060] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.110431 4411 raft_consensus.cc:2468] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 2.
I20251211 21:05:27.110471 4492 raft_consensus.cc:2468] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 2.
I20251211 21:05:27.110666 4289 leader_election.cc:304] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, 64a4a1a9596c4c51a460c1d35d6d77d5; no voters:
I20251211 21:05:27.110800 4528 raft_consensus.cc:2804] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:05:27.110904 4528 raft_consensus.cc:697] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 LEADER]: Becoming Leader. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Running, Role: LEADER
I20251211 21:05:27.111044 4528 consensus_queue.cc:237] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.112471 3862 catalog_manager.cc:5654] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:27.204811 4538 raft_consensus.cc:493] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:27.204947 4538 raft_consensus.cc:515] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.205479 4538 leader_election.cc:290] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:27.209017 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ac5dc6ea86a4041bff5c47e92102e53" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" is_pre_election: true
I20251211 21:05:27.209026 4328 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ac5dc6ea86a4041bff5c47e92102e53" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" is_pre_election: true
I20251211 21:05:27.209174 4411 raft_consensus.cc:2468] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 1.
I20251211 21:05:27.209209 4328 raft_consensus.cc:2468] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 1.
I20251211 21:05:27.209456 4452 leader_election.cc:304] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:27.209619 4538 raft_consensus.cc:2804] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 21:05:27.209681 4538 raft_consensus.cc:493] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:27.209725 4538 raft_consensus.cc:3060] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.210583 4538 raft_consensus.cc:515] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.210909 4538 leader_election.cc:290] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 2 election: Requested vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:27.211246 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ac5dc6ea86a4041bff5c47e92102e53" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
I20251211 21:05:27.211336 4411 raft_consensus.cc:3060] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.212173 4411 raft_consensus.cc:2468] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 2.
I20251211 21:05:27.212373 4328 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ac5dc6ea86a4041bff5c47e92102e53" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96"
I20251211 21:05:27.212424 4452 leader_election.cc:304] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:27.212477 4328 raft_consensus.cc:3060] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.212569 4538 raft_consensus.cc:2804] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:05:27.212782 4538 raft_consensus.cc:697] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 2 LEADER]: Becoming Leader. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Running, Role: LEADER
I20251211 21:05:27.212939 4538 consensus_queue.cc:237] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.213442 4328 raft_consensus.cc:2468] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 2.
I20251211 21:05:27.214529 3862 catalog_manager.cc:5654] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ff6a9feadef141f09b49f4c4365ba458" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:27.227562 4538 raft_consensus.cc:493] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:27.227769 4538 raft_consensus.cc:515] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.228199 4538 leader_election.cc:290] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:27.228627 4328 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" is_pre_election: true
I20251211 21:05:27.228701 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" is_pre_election: true
I20251211 21:05:27.228778 4411 raft_consensus.cc:2468] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 1.
I20251211 21:05:27.228804 4328 raft_consensus.cc:2410] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff6a9feadef141f09b49f4c4365ba458 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251211 21:05:27.229071 4452 leader_election.cc:304] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters: 38c13727bb6a4f0e8e64b9ce16c98e96
I20251211 21:05:27.229238 4538 raft_consensus.cc:2804] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 21:05:27.229296 4538 raft_consensus.cc:493] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:27.229331 4538 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.230157 4538 raft_consensus.cc:515] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.230469 4538 leader_election.cc:290] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 2 election: Requested vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:27.230798 4328 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96"
I20251211 21:05:27.230829 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "ff6a9feadef141f09b49f4c4365ba458" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
I20251211 21:05:27.230930 4328 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.230940 4411 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:27.231916 4411 raft_consensus.cc:2468] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6a9feadef141f09b49f4c4365ba458 in term 2.
I20251211 21:05:27.231966 4328 raft_consensus.cc:2410] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ff6a9feadef141f09b49f4c4365ba458 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251211 21:05:27.232223 4452 leader_election.cc:304] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters:
I20251211 21:05:27.232407 4538 raft_consensus.cc:2804] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:05:27.232502 4538 raft_consensus.cc:697] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 2 LEADER]: Becoming Leader. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Running, Role: LEADER
I20251211 21:05:27.232640 4538 consensus_queue.cc:237] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.234163 3862 catalog_manager.cc:5654] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 reported cstate change: term changed from 1 to 2, leader changed from 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193) to ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195). New cstate: current_term: 2 leader_uuid: "ff6a9feadef141f09b49f4c4365ba458" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:27.299892 4545 raft_consensus.cc:493] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:27.300040 4545 raft_consensus.cc:515] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.300529 4545 leader_election.cc:290] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:27.304132 4328 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" is_pre_election: true
I20251211 21:05:27.304132 4492 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458" is_pre_election: true
I20251211 21:05:27.304428 4492 raft_consensus.cc:2468] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64a4a1a9596c4c51a460c1d35d6d77d5 in term 2.
I20251211 21:05:27.304702 4371 leader_election.cc:304] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters: 38c13727bb6a4f0e8e64b9ce16c98e96
I20251211 21:05:27.304888 4545 raft_consensus.cc:2804] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251211 21:05:27.304955 4545 raft_consensus.cc:493] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:27.304986 4545 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:05:27.305852 4545 raft_consensus.cc:515] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.306231 4545 leader_election.cc:290] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [CANDIDATE]: Term 3 election: Requested vote from peers 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:27.306576 4328 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96"
I20251211 21:05:27.306633 4492 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b1938b2edaa4476bf97e2d7d01a9023" candidate_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458"
I20251211 21:05:27.306705 4492 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:05:27.307544 4492 raft_consensus.cc:2468] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64a4a1a9596c4c51a460c1d35d6d77d5 in term 3.
I20251211 21:05:27.307821 4371 leader_election.cc:304] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64a4a1a9596c4c51a460c1d35d6d77d5, ff6a9feadef141f09b49f4c4365ba458; no voters: 38c13727bb6a4f0e8e64b9ce16c98e96
I20251211 21:05:27.307979 4545 raft_consensus.cc:2804] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:05:27.308174 4545 raft_consensus.cc:697] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 LEADER]: Becoming Leader. State: Replica: 64a4a1a9596c4c51a460c1d35d6d77d5, State: Running, Role: LEADER
I20251211 21:05:27.308331 4545 consensus_queue.cc:237] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.309988 3862 catalog_manager.cc:5654] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 reported cstate change: term changed from 2 to 3, leader changed from 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193) to 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194). New cstate: current_term: 3 leader_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:27.314690 4411 raft_consensus.cc:1240] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 LEADER]: Rejecting Update request from peer 38c13727bb6a4f0e8e64b9ce16c98e96 for earlier term 2. Current term is 3. Ops: []
I20251211 21:05:27.315126 4528 consensus_queue.cc:1059] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.315292 4528 consensus_queue.cc:1243] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Peer 64a4a1a9596c4c51a460c1d35d6d77d5 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251211 21:05:27.315375 4531 raft_consensus.cc:3055] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 LEADER]: Stepping down as leader of term 2
I20251211 21:05:27.315423 4531 raft_consensus.cc:740] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Running, Role: LEADER
I20251211 21:05:27.315546 4531 consensus_queue.cc:260] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.315743 4531 raft_consensus.cc:3060] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:05:27.468492 4531 raft_consensus.cc:493] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:27.468663 4531 raft_consensus.cc:515] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.469131 4531 leader_election.cc:290] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:27.469614 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" is_pre_election: true
I20251211 21:05:27.469679 4492 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458" is_pre_election: true
I20251211 21:05:27.469759 4411 raft_consensus.cc:2468] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 2.
I20251211 21:05:27.470131 4289 leader_election.cc:304] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, 64a4a1a9596c4c51a460c1d35d6d77d5; no voters: ff6a9feadef141f09b49f4c4365ba458
I20251211 21:05:27.470299 4531 raft_consensus.cc:2804] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251211 21:05:27.470350 4531 raft_consensus.cc:493] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:27.470376 4531 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:05:27.471242 4531 raft_consensus.cc:515] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.471628 4531 leader_election.cc:290] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 3 election: Requested vote from peers 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965), ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195:42361)
I20251211 21:05:27.472029 4411 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5"
I20251211 21:05:27.472059 4492 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ada11cb3f80445579a01d43201cf153e" candidate_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff6a9feadef141f09b49f4c4365ba458"
I20251211 21:05:27.472134 4411 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Advancing to term 3
I20251211 21:05:27.472935 4411 raft_consensus.cc:2468] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c13727bb6a4f0e8e64b9ce16c98e96 in term 3.
I20251211 21:05:27.473207 4289 leader_election.cc:304] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38c13727bb6a4f0e8e64b9ce16c98e96, 64a4a1a9596c4c51a460c1d35d6d77d5; no voters: ff6a9feadef141f09b49f4c4365ba458
I20251211 21:05:27.473424 4531 raft_consensus.cc:2804] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: Leader election won for term 3
I20251211 21:05:27.473503 4531 raft_consensus.cc:697] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 LEADER]: Becoming Leader. State: Replica: 38c13727bb6a4f0e8e64b9ce16c98e96, State: Running, Role: LEADER
I20251211 21:05:27.473636 4531 consensus_queue.cc:237] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.475193 3862 catalog_manager.cc:5654] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 reported cstate change: term changed from 2 to 3, leader changed from ff6a9feadef141f09b49f4c4365ba458 (127.29.190.195) to 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193). New cstate: current_term: 3 leader_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:27.570470 4492 raft_consensus.cc:1275] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Refusing update from remote peer 38c13727bb6a4f0e8e64b9ce16c98e96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:05:27.570999 4531 consensus_queue.cc:1048] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.574506 4411 raft_consensus.cc:1275] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Refusing update from remote peer 38c13727bb6a4f0e8e64b9ce16c98e96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:05:27.574928 4553 consensus_queue.cc:1048] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.596449 4411 raft_consensus.cc:1275] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Refusing update from remote peer ff6a9feadef141f09b49f4c4365ba458: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:05:27.596890 4542 consensus_queue.cc:1048] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.599853 4328 raft_consensus.cc:1275] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Refusing update from remote peer ff6a9feadef141f09b49f4c4365ba458: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:05:27.600291 4558 consensus_queue.cc:1048] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.636889 4411 raft_consensus.cc:1240] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Rejecting Update request from peer ff6a9feadef141f09b49f4c4365ba458 for earlier term 2. Current term is 3. Ops: []
I20251211 21:05:27.637349 4558 consensus_queue.cc:1059] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.637516 4558 raft_consensus.cc:3055] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 2 LEADER]: Stepping down as leader of term 2
I20251211 21:05:27.637544 4558 raft_consensus.cc:740] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff6a9feadef141f09b49f4c4365ba458, State: Running, Role: LEADER
I20251211 21:05:27.637688 4558 consensus_queue.cc:260] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } }
I20251211 21:05:27.637841 4558 raft_consensus.cc:3060] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Advancing to term 3
W20251211 21:05:27.641893 3911 auto_rebalancer.cc:249] could not retrieve auto-rebalancing replica moves: Not found: table 4525c1a083eb4e35b43df114d343196e: could not find any suitable replica to move from server 38c13727bb6a4f0e8e64b9ce16c98e96 to server 40b9f3c96e0d40ffa2d9449d3ba7a709
I20251211 21:05:27.818739 4328 raft_consensus.cc:1275] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: Refusing update from remote peer 64a4a1a9596c4c51a460c1d35d6d77d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251211 21:05:27.819196 4548 consensus_queue.cc:1048] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.819394 4548 consensus_queue.cc:1243] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [LEADER]: Peer 38c13727bb6a4f0e8e64b9ce16c98e96 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251211 21:05:27.820199 4328 pending_rounds.cc:85] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Aborting all ops after (but not including) 0
I20251211 21:05:27.820261 4328 pending_rounds.cc:107] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20251211 21:05:27.820287 4328 raft_consensus.cc:2889] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251211 21:05:27.822347 4492 raft_consensus.cc:1275] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Refusing update from remote peer 64a4a1a9596c4c51a460c1d35d6d77d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251211 21:05:27.822744 4545 consensus_queue.cc:1048] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.960618 4411 raft_consensus.cc:1275] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Refusing update from remote peer 38c13727bb6a4f0e8e64b9ce16c98e96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251211 21:05:27.961062 4553 consensus_queue.cc:1048] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.963887 4492 raft_consensus.cc:1275] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Refusing update from remote peer 38c13727bb6a4f0e8e64b9ce16c98e96: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251211 21:05:27.964282 4528 consensus_queue.cc:1048] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:27.964426 4528 consensus_queue.cc:1243] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Peer ff6a9feadef141f09b49f4c4365ba458 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251211 21:05:27.965075 4492 pending_rounds.cc:85] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Aborting all ops after (but not including) 0
I20251211 21:05:27.965130 4492 pending_rounds.cc:107] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20251211 21:05:27.965165 4492 raft_consensus.cc:2889] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251211 21:05:28.644464 4411 consensus_queue.cc:237] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } attrs { replace: true } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:28.645900 4492 raft_consensus.cc:1275] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Refusing update from remote peer 64a4a1a9596c4c51a460c1d35d6d77d5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251211 21:05:28.645900 4328 raft_consensus.cc:1275] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: Refusing update from remote peer 64a4a1a9596c4c51a460c1d35d6d77d5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251211 21:05:28.646498 4545 consensus_queue.cc:1048] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:28.646720 4548 consensus_queue.cc:1048] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:28.648293 4545 raft_consensus.cc:2955] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } attrs { replace: true } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
I20251211 21:05:28.648748 4492 raft_consensus.cc:2955] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } attrs { replace: true } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
I20251211 21:05:28.648765 4328 raft_consensus.cc:2955] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } attrs { replace: true } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
W20251211 21:05:28.650977 4371 consensus_peers.cc:597] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 -> Peer 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196:44557): Couldn't send request to peer 40b9f3c96e0d40ffa2d9449d3ba7a709. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b1938b2edaa4476bf97e2d7d01a9023. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:28.651078 4328 consensus_queue.cc:237] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:28.651338 3862 catalog_manager.cc:5654] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 reported cstate change: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New cstate: current_term: 3 leader_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:28.652719 4411 raft_consensus.cc:1275] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Refusing update from remote peer 38c13727bb6a4f0e8e64b9ce16c98e96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251211 21:05:28.653012 4492 raft_consensus.cc:1275] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Refusing update from remote peer 38c13727bb6a4f0e8e64b9ce16c98e96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251211 21:05:28.653069 4531 consensus_queue.cc:1048] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:28.653564 4531 consensus_queue.cc:1048] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:28.655182 4531 raft_consensus.cc:2955] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
W20251211 21:05:28.657544 4289 consensus_peers.cc:597] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 -> Peer 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196:44557): Couldn't send request to peer 40b9f3c96e0d40ffa2d9449d3ba7a709. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c837acd9ae7d4c6c8ceade5c374ca951. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:28.657449 3861 catalog_manager.cc:5654] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 reported cstate change: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New cstate: current_term: 2 leader_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:28.657589 4492 raft_consensus.cc:2955] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
I20251211 21:05:28.657416 4328 consensus_queue.cc:237] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } attrs { replace: true } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:28.657424 4411 raft_consensus.cc:2955] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
W20251211 21:05:28.659767 4289 consensus_peers.cc:597] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 -> Peer 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196:44557): Couldn't send request to peer 40b9f3c96e0d40ffa2d9449d3ba7a709. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ada11cb3f80445579a01d43201cf153e. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:28.660005 4411 raft_consensus.cc:1275] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Refusing update from remote peer 38c13727bb6a4f0e8e64b9ce16c98e96: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251211 21:05:28.660102 4492 raft_consensus.cc:1275] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Refusing update from remote peer 38c13727bb6a4f0e8e64b9ce16c98e96: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251211 21:05:28.660435 4531 consensus_queue.cc:1048] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:28.660791 4528 consensus_queue.cc:1048] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:28.661865 4528 raft_consensus.cc:2955] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } attrs { replace: true } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
I20251211 21:05:28.662122 4492 raft_consensus.cc:2955] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } attrs { replace: true } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
I20251211 21:05:28.662508 4411 raft_consensus.cc:2955] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } attrs { replace: true } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } } }
I20251211 21:05:28.664132 3862 catalog_manager.cc:5654] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 reported cstate change: config changed from index -1 to 3, NON_VOTER 40b9f3c96e0d40ffa2d9449d3ba7a709 (127.29.190.196) added. New cstate: current_term: 3 leader_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:29.259214 4575 ts_tablet_manager.cc:933] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: Initiating tablet copy from peer 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837)
I20251211 21:05:29.259665 4575 tablet_copy_client.cc:323] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.193:41837
I20251211 21:05:29.261258 4579 ts_tablet_manager.cc:933] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Initiating tablet copy from peer 64a4a1a9596c4c51a460c1d35d6d77d5 (127.29.190.194:37965)
I20251211 21:05:29.261618 4579 tablet_copy_client.cc:323] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:37965
I20251211 21:05:29.263650 4339 tablet_copy_service.cc:140] P 38c13727bb6a4f0e8e64b9ce16c98e96: Received BeginTabletCopySession request for tablet ada11cb3f80445579a01d43201cf153e from peer 40b9f3c96e0d40ffa2d9449d3ba7a709 ({username='slave'} at 127.0.0.1:57582)
I20251211 21:05:29.263763 4339 tablet_copy_service.cc:161] P 38c13727bb6a4f0e8e64b9ce16c98e96: Beginning new tablet copy session on tablet ada11cb3f80445579a01d43201cf153e from peer 40b9f3c96e0d40ffa2d9449d3ba7a709 at {username='slave'} at 127.0.0.1:57582: session id = 40b9f3c96e0d40ffa2d9449d3ba7a709-ada11cb3f80445579a01d43201cf153e
I20251211 21:05:29.264788 4339 tablet_copy_source_session.cc:215] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:29.265672 4421 tablet_copy_service.cc:140] P 64a4a1a9596c4c51a460c1d35d6d77d5: Received BeginTabletCopySession request for tablet 1b1938b2edaa4476bf97e2d7d01a9023 from peer 40b9f3c96e0d40ffa2d9449d3ba7a709 ({username='slave'} at 127.0.0.1:57352)
I20251211 21:05:29.265761 4575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada11cb3f80445579a01d43201cf153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:29.265779 4421 tablet_copy_service.cc:161] P 64a4a1a9596c4c51a460c1d35d6d77d5: Beginning new tablet copy session on tablet 1b1938b2edaa4476bf97e2d7d01a9023 from peer 40b9f3c96e0d40ffa2d9449d3ba7a709 at {username='slave'} at 127.0.0.1:57352: session id = 40b9f3c96e0d40ffa2d9449d3ba7a709-1b1938b2edaa4476bf97e2d7d01a9023
I20251211 21:05:29.266630 4421 tablet_copy_source_session.cc:215] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:29.267364 4579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1938b2edaa4476bf97e2d7d01a9023. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:29.268205 4575 tablet_copy_client.cc:806] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:29.268395 4575 tablet_copy_client.cc:670] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:29.269344 4579 tablet_copy_client.cc:806] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:29.269558 4579 tablet_copy_client.cc:670] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:29.269795 4575 tablet_copy_client.cc:538] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:29.269959 4583 ts_tablet_manager.cc:933] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Initiating tablet copy from peer 38c13727bb6a4f0e8e64b9ce16c98e96 (127.29.190.193:41837)
I20251211 21:05:29.270323 4583 tablet_copy_client.cc:323] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.193:41837
I20251211 21:05:29.270519 4579 tablet_copy_client.cc:538] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:29.270967 4339 tablet_copy_service.cc:140] P 38c13727bb6a4f0e8e64b9ce16c98e96: Received BeginTabletCopySession request for tablet c837acd9ae7d4c6c8ceade5c374ca951 from peer 40b9f3c96e0d40ffa2d9449d3ba7a709 ({username='slave'} at 127.0.0.1:57582)
I20251211 21:05:29.271040 4339 tablet_copy_service.cc:161] P 38c13727bb6a4f0e8e64b9ce16c98e96: Beginning new tablet copy session on tablet c837acd9ae7d4c6c8ceade5c374ca951 from peer 40b9f3c96e0d40ffa2d9449d3ba7a709 at {username='slave'} at 127.0.0.1:57582: session id = 40b9f3c96e0d40ffa2d9449d3ba7a709-c837acd9ae7d4c6c8ceade5c374ca951
I20251211 21:05:29.271550 4575 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap starting.
I20251211 21:05:29.271729 4339 tablet_copy_source_session.cc:215] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:29.271744 4579 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap starting.
I20251211 21:05:29.272425 4583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c837acd9ae7d4c6c8ceade5c374ca951. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:29.274233 4583 tablet_copy_client.cc:806] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:29.274413 4583 tablet_copy_client.cc:670] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:29.275343 4583 tablet_copy_client.cc:538] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:29.275993 4579 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:29.276232 4579 tablet_bootstrap.cc:492] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap complete.
I20251211 21:05:29.276391 4579 ts_tablet_manager.cc:1403] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251211 21:05:29.276660 4583 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap starting.
I20251211 21:05:29.276944 4579 raft_consensus.cc:359] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } attrs { replace: true } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:29.277068 4579 raft_consensus.cc:740] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 40b9f3c96e0d40ffa2d9449d3ba7a709, State: Initialized, Role: LEARNER
I20251211 21:05:29.277196 4579 consensus_queue.cc:260] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } attrs { replace: true } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:29.277565 4579 ts_tablet_manager.cc:1434] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:29.278019 4421 tablet_copy_service.cc:342] P 64a4a1a9596c4c51a460c1d35d6d77d5: Request end of tablet copy session 40b9f3c96e0d40ffa2d9449d3ba7a709-1b1938b2edaa4476bf97e2d7d01a9023 received from {username='slave'} at 127.0.0.1:57352
I20251211 21:05:29.278098 4421 tablet_copy_service.cc:434] P 64a4a1a9596c4c51a460c1d35d6d77d5: ending tablet copy session 40b9f3c96e0d40ffa2d9449d3ba7a709-1b1938b2edaa4476bf97e2d7d01a9023 on tablet 1b1938b2edaa4476bf97e2d7d01a9023 with peer 40b9f3c96e0d40ffa2d9449d3ba7a709
I20251211 21:05:29.280000 4575 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:29.280249 4575 tablet_bootstrap.cc:492] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap complete.
I20251211 21:05:29.280458 4575 ts_tablet_manager.cc:1403] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20251211 21:05:29.280926 4575 raft_consensus.cc:359] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } attrs { replace: true } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:29.281061 4575 raft_consensus.cc:740] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 40b9f3c96e0d40ffa2d9449d3ba7a709, State: Initialized, Role: LEARNER
I20251211 21:05:29.281138 4583 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:29.281193 4575 consensus_queue.cc:260] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } attrs { replace: true } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:29.281368 4583 tablet_bootstrap.cc:492] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Bootstrap complete.
I20251211 21:05:29.281471 4575 ts_tablet_manager.cc:1434] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:29.281535 4583 ts_tablet_manager.cc:1403] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20251211 21:05:29.281852 4339 tablet_copy_service.cc:342] P 38c13727bb6a4f0e8e64b9ce16c98e96: Request end of tablet copy session 40b9f3c96e0d40ffa2d9449d3ba7a709-ada11cb3f80445579a01d43201cf153e received from {username='slave'} at 127.0.0.1:57582
I20251211 21:05:29.281926 4339 tablet_copy_service.cc:434] P 38c13727bb6a4f0e8e64b9ce16c98e96: ending tablet copy session 40b9f3c96e0d40ffa2d9449d3ba7a709-ada11cb3f80445579a01d43201cf153e on tablet ada11cb3f80445579a01d43201cf153e with peer 40b9f3c96e0d40ffa2d9449d3ba7a709
I20251211 21:05:29.281996 4583 raft_consensus.cc:359] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:29.282095 4583 raft_consensus.cc:740] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 40b9f3c96e0d40ffa2d9449d3ba7a709, State: Initialized, Role: LEARNER
I20251211 21:05:29.282181 4583 consensus_queue.cc:260] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "38c13727bb6a4f0e8e64b9ce16c98e96" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 41837 } } peers { permanent_uuid: "64a4a1a9596c4c51a460c1d35d6d77d5" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "ff6a9feadef141f09b49f4c4365ba458" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42361 } } peers { permanent_uuid: "40b9f3c96e0d40ffa2d9449d3ba7a709" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 44557 } attrs { promote: true } }
I20251211 21:05:29.282423 4583 ts_tablet_manager.cc:1434] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:29.282977 4339 tablet_copy_service.cc:342] P 38c13727bb6a4f0e8e64b9ce16c98e96: Request end of tablet copy session 40b9f3c96e0d40ffa2d9449d3ba7a709-c837acd9ae7d4c6c8ceade5c374ca951 received from {username='slave'} at 127.0.0.1:57582
I20251211 21:05:29.283039 4339 tablet_copy_service.cc:434] P 38c13727bb6a4f0e8e64b9ce16c98e96: ending tablet copy session 40b9f3c96e0d40ffa2d9449d3ba7a709-c837acd9ae7d4c6c8ceade5c374ca951 on tablet c837acd9ae7d4c6c8ceade5c374ca951 with peer 40b9f3c96e0d40ffa2d9449d3ba7a709
I20251211 21:05:29.663673 4239 raft_consensus.cc:1217] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20251211 21:05:29.758349 4239 raft_consensus.cc:1217] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20251211 21:05:29.849905 4239 raft_consensus.cc:1217] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20251211 21:05:29.852504 30459 tablet_server.cc:178] TabletServer@127.29.190.193:41837 shutting down...
W20251211 21:05:29.853452 3905 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20251211 21:05:29.854281 3911 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251211 21:05:29.854372 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251211 21:05:29.856105 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:29.856287 30459 tablet_replica.cc:333] stopping tablet replica
W20251211 21:05:29.856400 3911 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251211 21:05:29.856421 30459 raft_consensus.cc:2243] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Raft consensus shutting down.
W20251211 21:05:29.856451 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251211 21:05:29.856539 30459 raft_consensus.cc:2272] T 9ac5dc6ea86a4041bff5c47e92102e53 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.857039 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.857141 30459 raft_consensus.cc:2243] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:29.857263 30459 raft_consensus.cc:2272] T 1b1938b2edaa4476bf97e2d7d01a9023 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.857661 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.857753 30459 raft_consensus.cc:2243] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:05:29.857946 30459 raft_consensus.cc:2272] T c837acd9ae7d4c6c8ceade5c374ca951 P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.858301 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.858390 30459 raft_consensus.cc:2243] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 LEADER]: Raft consensus shutting down.
I20251211 21:05:29.858563 30459 raft_consensus.cc:2272] T ada11cb3f80445579a01d43201cf153e P 38c13727bb6a4f0e8e64b9ce16c98e96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.861946 30459 tablet_server.cc:195] TabletServer@127.29.190.193:41837 shutdown complete.
I20251211 21:05:29.864308 30459 tablet_server.cc:178] TabletServer@127.29.190.194:37965 shutting down...
W20251211 21:05:29.866627 3911 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251211 21:05:29.866768 3911 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251211 21:05:29.868928 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:29.869117 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.869251 30459 raft_consensus.cc:2243] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:29.869382 30459 raft_consensus.cc:2272] T 9ac5dc6ea86a4041bff5c47e92102e53 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.869890 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.869995 30459 raft_consensus.cc:2243] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 LEADER]: Raft consensus shutting down.
I20251211 21:05:29.870214 30459 raft_consensus.cc:2272] T 1b1938b2edaa4476bf97e2d7d01a9023 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.870607 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.870698 30459 raft_consensus.cc:2243] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:29.870807 30459 raft_consensus.cc:2272] T c837acd9ae7d4c6c8ceade5c374ca951 P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.871140 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.871237 30459 raft_consensus.cc:2243] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:29.871341 30459 raft_consensus.cc:2272] T ada11cb3f80445579a01d43201cf153e P 64a4a1a9596c4c51a460c1d35d6d77d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.884632 30459 tablet_server.cc:195] TabletServer@127.29.190.194:37965 shutdown complete.
I20251211 21:05:29.886993 30459 tablet_server.cc:178] TabletServer@127.29.190.195:42361 shutting down...
I20251211 21:05:29.890199 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:29.890396 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.890523 30459 raft_consensus.cc:2243] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:05:29.890719 30459 raft_consensus.cc:2272] T 9ac5dc6ea86a4041bff5c47e92102e53 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.891172 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.891261 30459 raft_consensus.cc:2243] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:29.891351 30459 raft_consensus.cc:2272] T 1b1938b2edaa4476bf97e2d7d01a9023 P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.891788 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.891875 30459 raft_consensus.cc:2243] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:29.891978 30459 raft_consensus.cc:2272] T c837acd9ae7d4c6c8ceade5c374ca951 P ff6a9feadef141f09b49f4c4365ba458 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.892300 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:29.892385 30459 raft_consensus.cc:2243] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:29.892485 30459 raft_consensus.cc:2272] T ada11cb3f80445579a01d43201cf153e P ff6a9feadef141f09b49f4c4365ba458 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.905905 30459 tablet_server.cc:195] TabletServer@127.29.190.195:42361 shutdown complete.
I20251211 21:05:29.908267 30459 tablet_server.cc:178] TabletServer@127.29.190.196:0 shutting down...
I20251211 21:05:29.911460 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:29.911715 30459 tablet_replica.cc:333] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709: stopping tablet replica
I20251211 21:05:29.911845 30459 raft_consensus.cc:2243] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 2 LEARNER]: Raft consensus shutting down.
I20251211 21:05:29.911960 30459 raft_consensus.cc:2272] T c837acd9ae7d4c6c8ceade5c374ca951 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 2 LEARNER]: Raft consensus is shut down!
I20251211 21:05:29.912384 30459 tablet_replica.cc:333] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709: stopping tablet replica
I20251211 21:05:29.912459 30459 raft_consensus.cc:2243] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Raft consensus shutting down.
I20251211 21:05:29.912530 30459 raft_consensus.cc:2272] T ada11cb3f80445579a01d43201cf153e P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Raft consensus is shut down!
I20251211 21:05:29.912811 30459 tablet_replica.cc:333] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709: stopping tablet replica
I20251211 21:05:29.912874 30459 raft_consensus.cc:2243] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Raft consensus shutting down.
I20251211 21:05:29.912945 30459 raft_consensus.cc:2272] T 1b1938b2edaa4476bf97e2d7d01a9023 P 40b9f3c96e0d40ffa2d9449d3ba7a709 [term 3 LEARNER]: Raft consensus is shut down!
I20251211 21:05:29.925420 30459 tablet_server.cc:195] TabletServer@127.29.190.196:0 shutdown complete.
I20251211 21:05:29.927563 30459 master.cc:561] Master@127.29.190.254:35687 shutting down...
I20251211 21:05:29.930989 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:29.931149 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:29.931197 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P d75cb3047c5542e9aef722de6af748c8: stopping tablet replica
I20251211 21:05:29.943667 30459 master.cc:583] Master@127.29.190.254:35687 shutdown complete.
[ OK ] AutoRebalancerTest.TestHandlingFailedTservers (11380 ms)
[ RUN ] AutoRebalancerTest.TestDeletedTables
I20251211 21:05:29.951920 30459 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.190.254:38075
I20251211 21:05:29.952278 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:29.953867 4594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:29.953904 4597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:29.953991 4595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:29.954181 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:29.954337 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:29.954371 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:29.954384 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487129954385 us; error 0 us; skew 500 ppm
I20251211 21:05:29.955207 30459 webserver.cc:492] Webserver started at http://127.29.190.254:42945/ using document root <none> and password file <none>
I20251211 21:05:29.955329 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:29.955368 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:29.955422 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:29.955806 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/master-0-root/instance:
uuid: "6b98c5f505da4dcaaa2b9481c238e269"
format_stamp: "Formatted at 2025-12-11 21:05:29 on dist-test-slave-xjj2"
I20251211 21:05:29.957094 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:29.957923 4602 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:29.958133 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:29.958194 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/master-0-root
uuid: "6b98c5f505da4dcaaa2b9481c238e269"
format_stamp: "Formatted at 2025-12-11 21:05:29 on dist-test-slave-xjj2"
I20251211 21:05:29.958259 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:29.975544 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:29.975975 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:29.979964 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.254:38075
I20251211 21:05:29.982501 4654 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.254:38075 every 8 connection(s)
I20251211 21:05:29.982962 4655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:29.984863 4655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: Bootstrap starting.
I20251211 21:05:29.985625 4655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:29.986573 4655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: No bootstrap required, opened a new log
I20251211 21:05:29.986972 4655 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b98c5f505da4dcaaa2b9481c238e269" member_type: VOTER }
I20251211 21:05:29.987058 4655 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:29.987080 4655 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b98c5f505da4dcaaa2b9481c238e269, State: Initialized, Role: FOLLOWER
I20251211 21:05:29.987205 4655 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b98c5f505da4dcaaa2b9481c238e269" member_type: VOTER }
I20251211 21:05:29.987272 4655 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 21:05:29.987306 4655 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 21:05:29.987352 4655 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:29.988070 4655 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b98c5f505da4dcaaa2b9481c238e269" member_type: VOTER }
I20251211 21:05:29.988206 4655 leader_election.cc:304] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b98c5f505da4dcaaa2b9481c238e269; no voters:
I20251211 21:05:29.988391 4655 leader_election.cc:290] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 21:05:29.988507 4658 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:29.988696 4658 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 1 LEADER]: Becoming Leader. State: Replica: 6b98c5f505da4dcaaa2b9481c238e269, State: Running, Role: LEADER
I20251211 21:05:29.988854 4655 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 21:05:29.988823 4658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b98c5f505da4dcaaa2b9481c238e269" member_type: VOTER }
I20251211 21:05:29.989261 4659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b98c5f505da4dcaaa2b9481c238e269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b98c5f505da4dcaaa2b9481c238e269" member_type: VOTER } }
I20251211 21:05:29.989295 4660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b98c5f505da4dcaaa2b9481c238e269. Latest consensus state: current_term: 1 leader_uuid: "6b98c5f505da4dcaaa2b9481c238e269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b98c5f505da4dcaaa2b9481c238e269" member_type: VOTER } }
I20251211 21:05:29.989454 4660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [sys.catalog]: This master's current role is: LEADER
I20251211 21:05:29.989418 4659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [sys.catalog]: This master's current role is: LEADER
I20251211 21:05:29.989876 4665 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 21:05:29.990690 4665 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 21:05:29.990859 30459 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 21:05:29.992432 4665 catalog_manager.cc:1357] Generated new cluster ID: f8144e3463a042d1ab183a8aca5fcabb
I20251211 21:05:29.992487 4665 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 21:05:30.006553 4665 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 21:05:30.007156 4665 catalog_manager.cc:1514] Loading token signing keys...
I20251211 21:05:30.014882 4665 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: Generated new TSK 0
I20251211 21:05:30.015092 4665 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 21:05:30.023172 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:05:30.025339 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:30.025341 4676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:30.025491 4677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:30.025389 4679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:30.025774 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:30.025818 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:30.025839 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487130025838 us; error 0 us; skew 500 ppm
I20251211 21:05:30.026744 30459 webserver.cc:492] Webserver started at http://127.29.190.193:32953/ using document root <none> and password file <none>
I20251211 21:05:30.026894 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:30.026947 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:30.027024 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:30.027407 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root/instance:
uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
format_stamp: "Formatted at 2025-12-11 21:05:30 on dist-test-slave-xjj2"
I20251211 21:05:30.028836 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:30.029703 4684 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.029918 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:30.029982 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
format_stamp: "Formatted at 2025-12-11 21:05:30 on dist-test-slave-xjj2"
I20251211 21:05:30.030058 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:30.041283 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:30.041688 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:30.041985 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:30.042433 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:30.042470 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.042510 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:30.042536 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.046368 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:37913
I20251211 21:05:30.046419 4747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:37913 every 8 connection(s)
I20251211 21:05:30.047158 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:30.048967 4755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:30.049103 4753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:30.049129 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:30.049132 4752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:30.049377 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:30.049415 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:30.049430 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487130049430 us; error 0 us; skew 500 ppm
I20251211 21:05:30.050321 30459 webserver.cc:492] Webserver started at http://127.29.190.194:42657/ using document root <none> and password file <none>
I20251211 21:05:30.050460 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:30.050515 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:30.050585 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:30.051005 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root/instance:
uuid: "965dd7fa3e144a568222c2753c9b030d"
format_stamp: "Formatted at 2025-12-11 21:05:30 on dist-test-slave-xjj2"
I20251211 21:05:30.051633 4748 heartbeater.cc:344] Connected to a master server at 127.29.190.254:38075
I20251211 21:05:30.051735 4748 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:30.051952 4748 heartbeater.cc:507] Master 127.29.190.254:38075 requested a full tablet report, sending...
I20251211 21:05:30.052551 4619 ts_manager.cc:194] Registered new tserver with Master: c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913)
I20251211 21:05:30.052695 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:30.053510 4619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37850
I20251211 21:05:30.053704 4760 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.053956 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:30.054024 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root
uuid: "965dd7fa3e144a568222c2753c9b030d"
format_stamp: "Formatted at 2025-12-11 21:05:30 on dist-test-slave-xjj2"
I20251211 21:05:30.054096 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:30.062191 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:30.062579 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:30.062855 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:30.063321 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:30.063361 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.063395 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:30.063422 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.067521 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.194:46557
I20251211 21:05:30.067560 4823 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.194:46557 every 8 connection(s)
I20251211 21:05:30.068362 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:30.070194 4828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:30.070163 4827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:30.070317 4830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:30.070485 30459 server_base.cc:1047] running on GCE node
I20251211 21:05:30.070638 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:30.070685 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:30.070708 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487130070707 us; error 0 us; skew 500 ppm
I20251211 21:05:30.071730 30459 webserver.cc:492] Webserver started at http://127.29.190.195:40895/ using document root <none> and password file <none>
I20251211 21:05:30.071880 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:30.071939 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:30.072017 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:30.072451 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root/instance:
uuid: "fbac55e4da7c40488f577c7be5f9acfb"
format_stamp: "Formatted at 2025-12-11 21:05:30 on dist-test-slave-xjj2"
I20251211 21:05:30.072805 4824 heartbeater.cc:344] Connected to a master server at 127.29.190.254:38075
I20251211 21:05:30.072888 4824 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:30.073108 4824 heartbeater.cc:507] Master 127.29.190.254:38075 requested a full tablet report, sending...
I20251211 21:05:30.073709 4619 ts_manager.cc:194] Registered new tserver with Master: 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:30.074076 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:30.074237 4619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37854
I20251211 21:05:30.075018 4835 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.075242 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:30.075313 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root
uuid: "fbac55e4da7c40488f577c7be5f9acfb"
format_stamp: "Formatted at 2025-12-11 21:05:30 on dist-test-slave-xjj2"
I20251211 21:05:30.075381 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:30.108253 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:30.108671 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:30.108963 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:30.109431 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:30.109469 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.109511 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:30.109539 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:30.113526 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.195:42167
I20251211 21:05:30.113552 4898 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.195:42167 every 8 connection(s)
I20251211 21:05:30.117852 4899 heartbeater.cc:344] Connected to a master server at 127.29.190.254:38075
I20251211 21:05:30.117971 4899 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:30.118198 4899 heartbeater.cc:507] Master 127.29.190.254:38075 requested a full tablet report, sending...
I20251211 21:05:30.118789 4619 ts_manager.cc:194] Registered new tserver with Master: fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:30.119313 4619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37860
I20251211 21:05:30.119639 30459 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005723955s
I20251211 21:05:31.054572 4748 heartbeater.cc:499] Master 127.29.190.254:38075 was elected leader, sending a full tablet report...
I20251211 21:05:31.075062 4824 heartbeater.cc:499] Master 127.29.190.254:38075 was elected leader, sending a full tablet report...
I20251211 21:05:31.120198 4899 heartbeater.cc:499] Master 127.29.190.254:38075 was elected leader, sending a full tablet report...
I20251211 21:05:31.145594 30459 test_util.cc:276] Using random seed: -2125548169
I20251211 21:05:31.159070 4619 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37870:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:05:31.159677 4619 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:05:31.170708 4712 tablet_service.cc:1505] Processing CreateTablet for tablet 98076b3eee6842ffb67489077988aa60 (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:31.170778 4711 tablet_service.cc:1505] Processing CreateTablet for tablet d80de04737374f31a5caf1cbfd5a289a (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:31.171085 4712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98076b3eee6842ffb67489077988aa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.171115 4709 tablet_service.cc:1505] Processing CreateTablet for tablet 5b81c60ef4e14f1182cd82bfc57e21e5 (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:31.171337 4785 tablet_service.cc:1505] Processing CreateTablet for tablet 5b81c60ef4e14f1182cd82bfc57e21e5 (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:31.171386 4710 tablet_service.cc:1505] Processing CreateTablet for tablet 78bbbb9ac14e4bb89eb7b0e12ee7c0dd (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:31.171633 4785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b81c60ef4e14f1182cd82bfc57e21e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.171897 4786 tablet_service.cc:1505] Processing CreateTablet for tablet 78bbbb9ac14e4bb89eb7b0e12ee7c0dd (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:31.172113 4786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bbbb9ac14e4bb89eb7b0e12ee7c0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.173933 4919 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d: Bootstrap starting.
I20251211 21:05:31.174094 4787 tablet_service.cc:1505] Processing CreateTablet for tablet d80de04737374f31a5caf1cbfd5a289a (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:31.174443 4787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80de04737374f31a5caf1cbfd5a289a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.174888 4919 tablet_bootstrap.cc:654] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.175933 4919 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d: No bootstrap required, opened a new log
I20251211 21:05:31.175879 4788 tablet_service.cc:1505] Processing CreateTablet for tablet 98076b3eee6842ffb67489077988aa60 (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:31.176002 4919 ts_tablet_manager.cc:1403] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:31.176107 4788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98076b3eee6842ffb67489077988aa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.176476 4919 raft_consensus.cc:359] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.176633 4709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b81c60ef4e14f1182cd82bfc57e21e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.176816 4710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bbbb9ac14e4bb89eb7b0e12ee7c0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.177492 4711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80de04737374f31a5caf1cbfd5a289a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.179478 4863 tablet_service.cc:1505] Processing CreateTablet for tablet 98076b3eee6842ffb67489077988aa60 (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:31.179764 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98076b3eee6842ffb67489077988aa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.180599 4919 raft_consensus.cc:385] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.180657 4919 raft_consensus.cc:740] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.180792 4919 consensus_queue.cc:260] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.181140 4919 ts_tablet_manager.cc:1434] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251211 21:05:31.181301 4919 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d: Bootstrap starting.
I20251211 21:05:31.181634 4923 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb: Bootstrap starting.
I20251211 21:05:31.181815 4862 tablet_service.cc:1505] Processing CreateTablet for tablet d80de04737374f31a5caf1cbfd5a289a (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:31.182060 4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80de04737374f31a5caf1cbfd5a289a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.182204 4919 tablet_bootstrap.cc:654] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.182592 4923 tablet_bootstrap.cc:654] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.182794 4921 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:31.183636 4921 tablet_bootstrap.cc:654] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.184204 4860 tablet_service.cc:1505] Processing CreateTablet for tablet 5b81c60ef4e14f1182cd82bfc57e21e5 (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:31.184445 4860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b81c60ef4e14f1182cd82bfc57e21e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.184401 4861 tablet_service.cc:1505] Processing CreateTablet for tablet 78bbbb9ac14e4bb89eb7b0e12ee7c0dd (DEFAULT_TABLE table=test-workload [id=24c60423bf534e35a54db9d692c60bf3]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:31.184628 4861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bbbb9ac14e4bb89eb7b0e12ee7c0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.184841 4921 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: No bootstrap required, opened a new log
I20251211 21:05:31.184953 4921 ts_tablet_manager.cc:1403] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:31.185379 4921 raft_consensus.cc:359] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.185495 4921 raft_consensus.cc:385] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.185524 4921 raft_consensus.cc:740] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.185652 4921 consensus_queue.cc:260] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.186003 4921 ts_tablet_manager.cc:1434] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.186189 4921 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:31.186894 4919 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d: No bootstrap required, opened a new log
I20251211 21:05:31.186990 4919 ts_tablet_manager.cc:1403] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251211 21:05:31.187148 4921 tablet_bootstrap.cc:654] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.187409 4919 raft_consensus.cc:359] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.187515 4919 raft_consensus.cc:385] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.187548 4919 raft_consensus.cc:740] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.187687 4919 consensus_queue.cc:260] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.187954 4919 ts_tablet_manager.cc:1434] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.188123 4921 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: No bootstrap required, opened a new log
I20251211 21:05:31.188215 4921 ts_tablet_manager.cc:1403] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:31.188568 4921 raft_consensus.cc:359] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.188668 4921 raft_consensus.cc:385] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.188699 4921 raft_consensus.cc:740] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.188715 4923 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb: No bootstrap required, opened a new log
I20251211 21:05:31.188781 4923 ts_tablet_manager.cc:1403] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251211 21:05:31.188807 4921 consensus_queue.cc:260] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.188128 4919 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: Bootstrap starting.
I20251211 21:05:31.189026 4921 ts_tablet_manager.cc:1434] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.189182 4921 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:31.189180 4923 raft_consensus.cc:359] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.189299 4923 raft_consensus.cc:385] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.189327 4923 raft_consensus.cc:740] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.189428 4923 consensus_queue.cc:260] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.189735 4923 ts_tablet_manager.cc:1434] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.189821 4919 tablet_bootstrap.cc:654] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.189932 4923 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: Bootstrap starting.
I20251211 21:05:31.190119 4921 tablet_bootstrap.cc:654] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.190812 4923 tablet_bootstrap.cc:654] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.191865 4921 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: No bootstrap required, opened a new log
I20251211 21:05:31.191959 4921 ts_tablet_manager.cc:1403] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251211 21:05:31.192358 4921 raft_consensus.cc:359] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.192466 4921 raft_consensus.cc:385] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.192507 4921 raft_consensus.cc:740] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.192615 4921 consensus_queue.cc:260] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.192874 4921 ts_tablet_manager.cc:1434] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:31.193028 4921 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:31.193038 4923 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: No bootstrap required, opened a new log
I20251211 21:05:31.193127 4923 ts_tablet_manager.cc:1403] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:31.193141 4919 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: No bootstrap required, opened a new log
I20251211 21:05:31.193221 4919 ts_tablet_manager.cc:1403] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251211 21:05:31.193511 4923 raft_consensus.cc:359] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.193612 4923 raft_consensus.cc:385] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.193642 4923 raft_consensus.cc:740] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.193641 4919 raft_consensus.cc:359] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.193765 4919 raft_consensus.cc:385] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.193799 4919 raft_consensus.cc:740] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.193841 4923 consensus_queue.cc:260] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.193924 4921 tablet_bootstrap.cc:654] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.193902 4919 consensus_queue.cc:260] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.194073 4923 ts_tablet_manager.cc:1434] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.194144 4919 ts_tablet_manager.cc:1434] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.194308 4919 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: Bootstrap starting.
I20251211 21:05:31.195227 4919 tablet_bootstrap.cc:654] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.196293 4921 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: No bootstrap required, opened a new log
I20251211 21:05:31.196372 4921 ts_tablet_manager.cc:1403] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20251211 21:05:31.196779 4923 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb: Bootstrap starting.
I20251211 21:05:31.196780 4921 raft_consensus.cc:359] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.196943 4921 raft_consensus.cc:385] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.196976 4921 raft_consensus.cc:740] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.197084 4921 consensus_queue.cc:260] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.197355 4921 ts_tablet_manager.cc:1434] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:31.197760 4923 tablet_bootstrap.cc:654] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.198860 4919 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: No bootstrap required, opened a new log
I20251211 21:05:31.198956 4919 ts_tablet_manager.cc:1403] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20251211 21:05:31.198957 4923 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb: No bootstrap required, opened a new log
I20251211 21:05:31.199080 4923 ts_tablet_manager.cc:1403] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:31.199420 4923 raft_consensus.cc:359] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.199404 4919 raft_consensus.cc:359] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.199535 4923 raft_consensus.cc:385] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.199554 4919 raft_consensus.cc:385] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.199568 4923 raft_consensus.cc:740] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.199632 4919 raft_consensus.cc:740] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.199724 4923 consensus_queue.cc:260] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.199741 4919 consensus_queue.cc:260] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.199987 4919 ts_tablet_manager.cc:1434] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:31.200057 4923 ts_tablet_manager.cc:1434] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.200228 4923 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: Bootstrap starting.
I20251211 21:05:31.201180 4923 tablet_bootstrap.cc:654] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.202234 4923 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: No bootstrap required, opened a new log
I20251211 21:05:31.202329 4923 ts_tablet_manager.cc:1403] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 21:05:31.202749 4923 raft_consensus.cc:359] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.202841 4923 raft_consensus.cc:385] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.202872 4923 raft_consensus.cc:740] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.202987 4923 consensus_queue.cc:260] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.203200 4923 ts_tablet_manager.cc:1434] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:31.216034 4927 raft_consensus.cc:493] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:31.216163 4927 raft_consensus.cc:515] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.216657 4927 leader_election.cc:290] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:31.221222 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78bbbb9ac14e4bb89eb7b0e12ee7c0dd" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d" is_pre_election: true
I20251211 21:05:31.221382 4798 raft_consensus.cc:2468] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 0.
I20251211 21:05:31.221642 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78bbbb9ac14e4bb89eb7b0e12ee7c0dd" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb" is_pre_election: true
I20251211 21:05:31.221769 4873 raft_consensus.cc:2468] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 0.
I20251211 21:05:31.221774 4687 leader_election.cc:304] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, c8ee4a31e69b4bdfb62c0fc4337def61; no voters:
I20251211 21:05:31.222010 4927 raft_consensus.cc:2804] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:31.222067 4927 raft_consensus.cc:493] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:31.222107 4927 raft_consensus.cc:3060] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.222988 4927 raft_consensus.cc:515] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.223340 4927 leader_election.cc:290] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 election: Requested vote from peers 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:31.223732 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78bbbb9ac14e4bb89eb7b0e12ee7c0dd" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb"
I20251211 21:05:31.223830 4873 raft_consensus.cc:3060] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.224644 4873 raft_consensus.cc:2468] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 1.
I20251211 21:05:31.224849 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78bbbb9ac14e4bb89eb7b0e12ee7c0dd" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d"
I20251211 21:05:31.224913 4688 leader_election.cc:304] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.224960 4798 raft_consensus.cc:3060] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.225085 4927 raft_consensus.cc:2804] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:31.225304 4927 raft_consensus.cc:697] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: Becoming Leader. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Running, Role: LEADER
I20251211 21:05:31.225445 4927 consensus_queue.cc:237] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.225823 4798 raft_consensus.cc:2468] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 1.
I20251211 21:05:31.226982 4617 catalog_manager.cc:5654] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193). New cstate: current_term: 1 leader_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:31.335371 4929 raft_consensus.cc:493] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:31.335534 4929 raft_consensus.cc:515] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.336143 4929 leader_election.cc:290] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:31.340682 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d80de04737374f31a5caf1cbfd5a289a" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" is_pre_election: true
I20251211 21:05:31.340680 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d80de04737374f31a5caf1cbfd5a289a" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d" is_pre_election: true
I20251211 21:05:31.340899 4722 raft_consensus.cc:2468] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 0.
I20251211 21:05:31.340899 4798 raft_consensus.cc:2468] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 0.
I20251211 21:05:31.341259 4838 leader_election.cc:304] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.341475 4929 raft_consensus.cc:2804] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:31.341540 4929 raft_consensus.cc:493] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:31.341566 4929 raft_consensus.cc:3060] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.342446 4929 raft_consensus.cc:515] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.342809 4929 leader_election.cc:290] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 election: Requested vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:31.343171 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d80de04737374f31a5caf1cbfd5a289a" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d"
I20251211 21:05:31.343171 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d80de04737374f31a5caf1cbfd5a289a" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
I20251211 21:05:31.343310 4798 raft_consensus.cc:3060] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.343328 4722 raft_consensus.cc:3060] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.344286 4798 raft_consensus.cc:2468] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:31.344286 4722 raft_consensus.cc:2468] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:31.344640 4839 leader_election.cc:304] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.344841 4929 raft_consensus.cc:2804] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:31.345049 4929 raft_consensus.cc:697] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Becoming Leader. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Running, Role: LEADER
I20251211 21:05:31.345183 4929 consensus_queue.cc:237] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.346776 4617 catalog_manager.cc:5654] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb reported cstate change: term changed from 0 to 1, leader changed from <none> to fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195). New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:31.467087 4927 raft_consensus.cc:493] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:31.467237 4927 raft_consensus.cc:515] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.467756 4927 leader_election.cc:290] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:31.468184 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b81c60ef4e14f1182cd82bfc57e21e5" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb" is_pre_election: true
I20251211 21:05:31.468184 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b81c60ef4e14f1182cd82bfc57e21e5" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d" is_pre_election: true
I20251211 21:05:31.468364 4873 raft_consensus.cc:2468] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 0.
I20251211 21:05:31.468364 4798 raft_consensus.cc:2468] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 0.
I20251211 21:05:31.468648 4688 leader_election.cc:304] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.468806 4927 raft_consensus.cc:2804] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:31.468865 4927 raft_consensus.cc:493] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:31.468892 4927 raft_consensus.cc:3060] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.469735 4927 raft_consensus.cc:515] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.470096 4927 leader_election.cc:290] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 election: Requested vote from peers 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:31.470489 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b81c60ef4e14f1182cd82bfc57e21e5" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb"
I20251211 21:05:31.470489 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b81c60ef4e14f1182cd82bfc57e21e5" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d"
I20251211 21:05:31.470698 4873 raft_consensus.cc:3060] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.470698 4798 raft_consensus.cc:3060] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.471791 4873 raft_consensus.cc:2468] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 1.
I20251211 21:05:31.471797 4798 raft_consensus.cc:2468] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 1.
I20251211 21:05:31.472154 4687 leader_election.cc:304] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, c8ee4a31e69b4bdfb62c0fc4337def61; no voters:
I20251211 21:05:31.472321 4927 raft_consensus.cc:2804] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:31.472404 4927 raft_consensus.cc:697] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: Becoming Leader. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Running, Role: LEADER
I20251211 21:05:31.472671 4927 consensus_queue.cc:237] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.474308 4617 catalog_manager.cc:5654] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193). New cstate: current_term: 1 leader_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:31.543624 4922 raft_consensus.cc:493] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:31.543800 4922 raft_consensus.cc:515] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.544284 4922 leader_election.cc:290] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:31.548035 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98076b3eee6842ffb67489077988aa60" candidate_uuid: "965dd7fa3e144a568222c2753c9b030d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" is_pre_election: true
I20251211 21:05:31.548228 4722 raft_consensus.cc:2468] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 965dd7fa3e144a568222c2753c9b030d in term 0.
I20251211 21:05:31.548241 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98076b3eee6842ffb67489077988aa60" candidate_uuid: "965dd7fa3e144a568222c2753c9b030d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb" is_pre_election: true
I20251211 21:05:31.548417 4873 raft_consensus.cc:2468] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 965dd7fa3e144a568222c2753c9b030d in term 0.
I20251211 21:05:31.548553 4764 leader_election.cc:304] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, c8ee4a31e69b4bdfb62c0fc4337def61; no voters:
I20251211 21:05:31.548868 4922 raft_consensus.cc:2804] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:31.548928 4922 raft_consensus.cc:493] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:31.548955 4922 raft_consensus.cc:3060] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.549770 4922 raft_consensus.cc:515] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.550088 4922 leader_election.cc:290] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [CANDIDATE]: Term 1 election: Requested vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:31.550393 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98076b3eee6842ffb67489077988aa60" candidate_uuid: "965dd7fa3e144a568222c2753c9b030d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
I20251211 21:05:31.550498 4722 raft_consensus.cc:3060] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.550494 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98076b3eee6842ffb67489077988aa60" candidate_uuid: "965dd7fa3e144a568222c2753c9b030d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb"
I20251211 21:05:31.550644 4873 raft_consensus.cc:3060] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.551309 4722 raft_consensus.cc:2468] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 965dd7fa3e144a568222c2753c9b030d in term 1.
I20251211 21:05:31.551364 4873 raft_consensus.cc:2468] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 965dd7fa3e144a568222c2753c9b030d in term 1.
I20251211 21:05:31.551597 4764 leader_election.cc:304] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.551808 4922 raft_consensus.cc:2804] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:31.552027 4922 raft_consensus.cc:697] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 LEADER]: Becoming Leader. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Running, Role: LEADER
I20251211 21:05:31.552163 4922 consensus_queue.cc:237] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.553679 4617 catalog_manager.cc:5654] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d reported cstate change: term changed from 0 to 1, leader changed from <none> to 965dd7fa3e144a568222c2753c9b030d (127.29.190.194). New cstate: current_term: 1 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:31.616080 30459 test_util.cc:276] Using random seed: -2125077690
I20251211 21:05:31.623828 4617 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37882:
name: "dugtrio"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 21:05:31.624366 4617 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table dugtrio in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 21:05:31.629884 4709 tablet_service.cc:1505] Processing CreateTablet for tablet af852bf62bc24e33b6633d17972b0280 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:31.630017 4788 tablet_service.cc:1505] Processing CreateTablet for tablet af852bf62bc24e33b6633d17972b0280 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:31.630182 4709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af852bf62bc24e33b6633d17972b0280. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.630290 4788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af852bf62bc24e33b6633d17972b0280. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.630911 4711 tablet_service.cc:1505] Processing CreateTablet for tablet b92158a490f14334bd1b7f7b31a5fdf9 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:31.631012 4861 tablet_service.cc:1505] Processing CreateTablet for tablet b92158a490f14334bd1b7f7b31a5fdf9 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:31.631175 4711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92158a490f14334bd1b7f7b31a5fdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.631263 4861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92158a490f14334bd1b7f7b31a5fdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.631927 4860 tablet_service.cc:1505] Processing CreateTablet for tablet af852bf62bc24e33b6633d17972b0280 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 21:05:31.632156 4860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af852bf62bc24e33b6633d17972b0280. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.632357 4710 tablet_service.cc:1505] Processing CreateTablet for tablet 6780adca868d4754b674f91b339c1ce7 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:31.632587 4710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6780adca868d4754b674f91b339c1ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.634281 4923 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: Bootstrap starting.
I20251211 21:05:31.634415 4712 tablet_service.cc:1505] Processing CreateTablet for tablet c0538165eb5e4bfe9f76e053044f7985 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:31.634512 4921 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:31.634625 4712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0538165eb5e4bfe9f76e053044f7985. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.634838 4863 tablet_service.cc:1505] Processing CreateTablet for tablet c0538165eb5e4bfe9f76e053044f7985 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:31.635048 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0538165eb5e4bfe9f76e053044f7985. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.635290 4923 tablet_bootstrap.cc:654] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.635294 4921 tablet_bootstrap.cc:654] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.634580 4862 tablet_service.cc:1505] Processing CreateTablet for tablet 6780adca868d4754b674f91b339c1ce7 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:31.636914 4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6780adca868d4754b674f91b339c1ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.636994 4921 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: No bootstrap required, opened a new log
I20251211 21:05:31.637076 4921 ts_tablet_manager.cc:1403] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20251211 21:05:31.637490 4921 raft_consensus.cc:359] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.637573 4921 raft_consensus.cc:385] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.637591 4921 raft_consensus.cc:740] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.637697 4921 consensus_queue.cc:260] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.637934 4921 ts_tablet_manager.cc:1434] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:31.638057 4921 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:31.632339 4787 tablet_service.cc:1505] Processing CreateTablet for tablet b92158a490f14334bd1b7f7b31a5fdf9 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 21:05:31.638914 4921 tablet_bootstrap.cc:654] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.639056 4786 tablet_service.cc:1505] Processing CreateTablet for tablet 6780adca868d4754b674f91b339c1ce7 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 21:05:31.638926 4787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92158a490f14334bd1b7f7b31a5fdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.639266 4786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6780adca868d4754b674f91b339c1ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.640995 4785 tablet_service.cc:1505] Processing CreateTablet for tablet c0538165eb5e4bfe9f76e053044f7985 (DEFAULT_TABLE table=dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 21:05:31.641212 4785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0538165eb5e4bfe9f76e053044f7985. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:31.641213 4919 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: Bootstrap starting.
I20251211 21:05:31.642009 4923 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: No bootstrap required, opened a new log
I20251211 21:05:31.642023 4919 tablet_bootstrap.cc:654] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.642110 4923 ts_tablet_manager.cc:1403] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20251211 21:05:31.642536 4923 raft_consensus.cc:359] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.642635 4923 raft_consensus.cc:385] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.642664 4923 raft_consensus.cc:740] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.642781 4923 consensus_queue.cc:260] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.642969 4919 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: No bootstrap required, opened a new log
I20251211 21:05:31.643046 4919 ts_tablet_manager.cc:1403] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251211 21:05:31.643422 4923 ts_tablet_manager.cc:1434] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:31.643443 4919 raft_consensus.cc:359] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.643555 4919 raft_consensus.cc:385] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.643628 4923 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: Bootstrap starting.
I20251211 21:05:31.644025 4921 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: No bootstrap required, opened a new log
I20251211 21:05:31.644119 4921 ts_tablet_manager.cc:1403] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20251211 21:05:31.644510 4921 raft_consensus.cc:359] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.644606 4921 raft_consensus.cc:385] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.644652 4921 raft_consensus.cc:740] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.644783 4921 consensus_queue.cc:260] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.643633 4919 raft_consensus.cc:740] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.645041 4921 ts_tablet_manager.cc:1434] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:31.645208 4921 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:31.645004 4919 consensus_queue.cc:260] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.645578 4919 ts_tablet_manager.cc:1434] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251211 21:05:31.645740 4919 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: Bootstrap starting.
I20251211 21:05:31.646114 4921 tablet_bootstrap.cc:654] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.646625 4919 tablet_bootstrap.cc:654] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.647328 4921 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: No bootstrap required, opened a new log
I20251211 21:05:31.647411 4921 ts_tablet_manager.cc:1403] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:05:31.647526 4923 tablet_bootstrap.cc:654] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.647751 4919 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: No bootstrap required, opened a new log
I20251211 21:05:31.647822 4919 ts_tablet_manager.cc:1403] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251211 21:05:31.647864 4921 raft_consensus.cc:359] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.647977 4921 raft_consensus.cc:385] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.648010 4921 raft_consensus.cc:740] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.648118 4921 consensus_queue.cc:260] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.648207 4919 raft_consensus.cc:359] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.648295 4919 raft_consensus.cc:385] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.648334 4919 raft_consensus.cc:740] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.648370 4921 ts_tablet_manager.cc:1434] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.648428 4919 consensus_queue.cc:260] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.648528 4921 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:31.648662 4919 ts_tablet_manager.cc:1434] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:31.648813 4919 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: Bootstrap starting.
I20251211 21:05:31.649448 4921 tablet_bootstrap.cc:654] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.649718 4919 tablet_bootstrap.cc:654] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.650704 4919 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: No bootstrap required, opened a new log
I20251211 21:05:31.650782 4919 ts_tablet_manager.cc:1403] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251211 21:05:31.651162 4919 raft_consensus.cc:359] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.651252 4919 raft_consensus.cc:385] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.651280 4919 raft_consensus.cc:740] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.651386 4919 consensus_queue.cc:260] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.651650 4919 ts_tablet_manager.cc:1434] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:31.651816 4919 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: Bootstrap starting.
I20251211 21:05:31.652302 4921 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: No bootstrap required, opened a new log
I20251211 21:05:31.652383 4921 ts_tablet_manager.cc:1403] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:05:31.652433 4923 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: No bootstrap required, opened a new log
I20251211 21:05:31.652515 4923 ts_tablet_manager.cc:1403] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20251211 21:05:31.652781 4919 tablet_bootstrap.cc:654] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.652961 4921 raft_consensus.cc:359] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.652992 4923 raft_consensus.cc:359] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.653060 4921 raft_consensus.cc:385] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.653079 4923 raft_consensus.cc:385] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.653093 4921 raft_consensus.cc:740] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.653110 4923 raft_consensus.cc:740] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.653211 4921 consensus_queue.cc:260] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.653216 4923 consensus_queue.cc:260] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.653494 4921 ts_tablet_manager.cc:1434] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.653522 4923 ts_tablet_manager.cc:1434] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:31.653721 4923 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: Bootstrap starting.
I20251211 21:05:31.654145 4919 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: No bootstrap required, opened a new log
I20251211 21:05:31.654220 4919 ts_tablet_manager.cc:1403] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251211 21:05:31.654592 4919 raft_consensus.cc:359] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.654659 4923 tablet_bootstrap.cc:654] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.654702 4919 raft_consensus.cc:385] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.654738 4919 raft_consensus.cc:740] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.654852 4919 consensus_queue.cc:260] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.655112 4919 ts_tablet_manager.cc:1434] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.655848 4923 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: No bootstrap required, opened a new log
I20251211 21:05:31.655932 4923 ts_tablet_manager.cc:1403] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251211 21:05:31.656347 4923 raft_consensus.cc:359] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.656447 4923 raft_consensus.cc:385] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.656481 4923 raft_consensus.cc:740] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.656579 4923 consensus_queue.cc:260] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.656844 4923 ts_tablet_manager.cc:1434] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:31.657064 4923 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: Bootstrap starting.
I20251211 21:05:31.657936 4923 tablet_bootstrap.cc:654] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: Neither blocks nor log segments found. Creating new log.
I20251211 21:05:31.658975 4923 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: No bootstrap required, opened a new log
I20251211 21:05:31.659060 4923 ts_tablet_manager.cc:1403] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251211 21:05:31.659446 4923 raft_consensus.cc:359] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.659530 4923 raft_consensus.cc:385] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 21:05:31.659561 4923 raft_consensus.cc:740] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Initialized, Role: FOLLOWER
I20251211 21:05:31.659705 4923 consensus_queue.cc:260] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.659978 4923 ts_tablet_manager.cc:1434] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:31.694083 4929 raft_consensus.cc:493] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:31.694233 4929 raft_consensus.cc:515] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.694635 4929 leader_election.cc:290] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:31.695097 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af852bf62bc24e33b6633d17972b0280" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d" is_pre_election: true
I20251211 21:05:31.695097 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af852bf62bc24e33b6633d17972b0280" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" is_pre_election: true
I20251211 21:05:31.695281 4722 raft_consensus.cc:2468] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 0.
I20251211 21:05:31.695281 4798 raft_consensus.cc:2468] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 0.
I20251211 21:05:31.695596 4838 leader_election.cc:304] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.695820 4929 raft_consensus.cc:2804] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:31.695886 4929 raft_consensus.cc:493] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:31.695912 4929 raft_consensus.cc:3060] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.696913 4929 raft_consensus.cc:515] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.697268 4929 leader_election.cc:290] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 election: Requested vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:31.697602 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af852bf62bc24e33b6633d17972b0280" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
I20251211 21:05:31.697713 4722 raft_consensus.cc:3060] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.698472 4722 raft_consensus.cc:2468] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:31.698755 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af852bf62bc24e33b6633d17972b0280" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d"
I20251211 21:05:31.698766 4839 leader_election.cc:304] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.698879 4798 raft_consensus.cc:3060] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.698976 4929 raft_consensus.cc:2804] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:31.699051 4929 raft_consensus.cc:697] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Becoming Leader. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Running, Role: LEADER
I20251211 21:05:31.699179 4929 consensus_queue.cc:237] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.699761 4798 raft_consensus.cc:2468] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:31.700667 4617 catalog_manager.cc:5654] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb reported cstate change: term changed from 0 to 1, leader changed from <none> to fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195). New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:31.728931 4929 raft_consensus.cc:493] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:31.729082 4929 raft_consensus.cc:515] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.729528 4929 leader_election.cc:290] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:31.729948 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b92158a490f14334bd1b7f7b31a5fdf9" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d" is_pre_election: true
I20251211 21:05:31.729949 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b92158a490f14334bd1b7f7b31a5fdf9" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" is_pre_election: true
I20251211 21:05:31.730085 4798 raft_consensus.cc:2468] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 0.
I20251211 21:05:31.730137 4722 raft_consensus.cc:2468] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 0.
I20251211 21:05:31.730374 4838 leader_election.cc:304] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.730552 4929 raft_consensus.cc:2804] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:31.730613 4929 raft_consensus.cc:493] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:31.730641 4929 raft_consensus.cc:3060] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.731524 4929 raft_consensus.cc:515] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.731917 4929 leader_election.cc:290] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 election: Requested vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:31.732206 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b92158a490f14334bd1b7f7b31a5fdf9" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
I20251211 21:05:31.732208 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b92158a490f14334bd1b7f7b31a5fdf9" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d"
I20251211 21:05:31.732334 4722 raft_consensus.cc:3060] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.732349 4798 raft_consensus.cc:3060] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.733131 4722 raft_consensus.cc:2468] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:31.733150 4798 raft_consensus.cc:2468] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:31.733382 4839 leader_election.cc:304] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.733554 4929 raft_consensus.cc:2804] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:31.733636 4929 raft_consensus.cc:697] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Becoming Leader. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Running, Role: LEADER
I20251211 21:05:31.733788 4929 consensus_queue.cc:237] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.735298 4617 catalog_manager.cc:5654] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb reported cstate change: term changed from 0 to 1, leader changed from <none> to fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195). New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:31.738570 4927 raft_consensus.cc:493] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:31.738673 4927 raft_consensus.cc:515] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.739009 4927 leader_election.cc:290] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:31.739334 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0538165eb5e4bfe9f76e053044f7985" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb" is_pre_election: true
I20251211 21:05:31.739435 4873 raft_consensus.cc:2468] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 0.
I20251211 21:05:31.739634 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0538165eb5e4bfe9f76e053044f7985" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d" is_pre_election: true
I20251211 21:05:31.739701 4688 leader_election.cc:304] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.739730 4798 raft_consensus.cc:2468] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 0.
I20251211 21:05:31.739867 4927 raft_consensus.cc:2804] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:31.739928 4927 raft_consensus.cc:493] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:31.739972 4927 raft_consensus.cc:3060] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.740756 4927 raft_consensus.cc:515] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.741055 4927 leader_election.cc:290] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 election: Requested vote from peers 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:31.741338 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0538165eb5e4bfe9f76e053044f7985" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb"
I20251211 21:05:31.741420 4873 raft_consensus.cc:3060] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.742240 4873 raft_consensus.cc:2468] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 1.
I20251211 21:05:31.742448 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0538165eb5e4bfe9f76e053044f7985" candidate_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d"
I20251211 21:05:31.742542 4798 raft_consensus.cc:3060] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.742522 4688 leader_election.cc:304] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.742753 4927 raft_consensus.cc:2804] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:31.742832 4927 raft_consensus.cc:697] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: Becoming Leader. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Running, Role: LEADER
I20251211 21:05:31.742965 4927 consensus_queue.cc:237] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.743361 4798 raft_consensus.cc:2468] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8ee4a31e69b4bdfb62c0fc4337def61 in term 1.
I20251211 21:05:31.744515 4617 catalog_manager.cc:5654] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193). New cstate: current_term: 1 leader_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:31.773049 4929 raft_consensus.cc:493] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:31.773212 4929 raft_consensus.cc:515] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.773612 4929 leader_election.cc:290] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:31.774052 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6780adca868d4754b674f91b339c1ce7" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" is_pre_election: true
I20251211 21:05:31.774055 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6780adca868d4754b674f91b339c1ce7" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d" is_pre_election: true
I20251211 21:05:31.774210 4722 raft_consensus.cc:2468] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 0.
I20251211 21:05:31.774222 4798 raft_consensus.cc:2468] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 0.
I20251211 21:05:31.774500 4839 leader_election.cc:304] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.774709 4929 raft_consensus.cc:2804] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 21:05:31.774762 4929 raft_consensus.cc:493] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:31.774791 4929 raft_consensus.cc:3060] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.775668 4929 raft_consensus.cc:515] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.776029 4929 leader_election.cc:290] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 election: Requested vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:31.776367 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6780adca868d4754b674f91b339c1ce7" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d"
I20251211 21:05:31.776367 4722 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6780adca868d4754b674f91b339c1ce7" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
I20251211 21:05:31.776511 4798 raft_consensus.cc:3060] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.776511 4722 raft_consensus.cc:3060] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 0 FOLLOWER]: Advancing to term 1
I20251211 21:05:31.777462 4722 raft_consensus.cc:2468] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:31.777462 4798 raft_consensus.cc:2468] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:31.777838 4838 leader_election.cc:304] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, c8ee4a31e69b4bdfb62c0fc4337def61, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:31.778018 4929 raft_consensus.cc:2804] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 21:05:31.778105 4929 raft_consensus.cc:697] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Becoming Leader. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Running, Role: LEADER
I20251211 21:05:31.778237 4929 consensus_queue.cc:237] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:31.779910 4617 catalog_manager.cc:5654] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb reported cstate change: term changed from 0 to 1, leader changed from <none> to fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195). New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:31.786331 30459 tablet_server.cc:178] TabletServer@127.29.190.193:0 shutting down...
I20251211 21:05:31.789747 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:31.790015 30459 tablet_replica.cc:333] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: stopping tablet replica
I20251211 21:05:31.790148 30459 raft_consensus.cc:2243] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:31.790297 30459 pending_rounds.cc:70] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Trying to abort 1 pending ops.
I20251211 21:05:31.790323 30459 pending_rounds.cc:77] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231435291620454400 op_type: NO_OP noop_request { }
I20251211 21:05:31.790385 30459 raft_consensus.cc:2889] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:05:31.790426 30459 raft_consensus.cc:2272] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:31.791237 30459 tablet_replica.cc:333] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: stopping tablet replica
I20251211 21:05:31.791356 30459 raft_consensus.cc:2243] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:31.791466 30459 raft_consensus.cc:2272] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:31.791922 30459 tablet_replica.cc:333] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: stopping tablet replica
I20251211 21:05:31.792025 30459 raft_consensus.cc:2243] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:31.792058 4939 consensus_queue.cc:1048] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:31.792317 30459 pending_rounds.cc:70] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Trying to abort 1 pending ops.
I20251211 21:05:31.792353 30459 pending_rounds.cc:77] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231435289501003776 op_type: NO_OP noop_request { }
I20251211 21:05:31.792409 30459 raft_consensus.cc:2889] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:05:31.792462 30459 raft_consensus.cc:2272] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:31.792906 30459 tablet_replica.cc:333] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: stopping tablet replica
I20251211 21:05:31.792992 30459 raft_consensus.cc:2243] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:31.793076 30459 raft_consensus.cc:2272] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:31.793358 30459 tablet_replica.cc:333] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: stopping tablet replica
I20251211 21:05:31.793442 30459 raft_consensus.cc:2243] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:31.793553 30459 pending_rounds.cc:70] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Trying to abort 1 pending ops.
I20251211 21:05:31.793581 30459 pending_rounds.cc:77] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231435290513588224 op_type: NO_OP noop_request { }
I20251211 21:05:31.793633 30459 raft_consensus.cc:2889] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:05:31.793686 30459 raft_consensus.cc:2272] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:31.794075 30459 tablet_replica.cc:333] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: stopping tablet replica
I20251211 21:05:31.794148 30459 raft_consensus.cc:2243] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:31.794229 30459 raft_consensus.cc:2272] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:31.794548 30459 tablet_replica.cc:333] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: stopping tablet replica
I20251211 21:05:31.794621 30459 raft_consensus.cc:2243] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:31.794703 30459 raft_consensus.cc:2272] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:31.794982 30459 tablet_replica.cc:333] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: stopping tablet replica
I20251211 21:05:31.795069 30459 raft_consensus.cc:2243] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:31.795149 30459 raft_consensus.cc:2272] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251211 21:05:31.798599 4839 consensus_peers.cc:597] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb -> Peer c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): Couldn't send request to peer c8ee4a31e69b4bdfb62c0fc4337def61. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:37913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:31.808844 30459 tablet_server.cc:195] TabletServer@127.29.190.193:0 shutdown complete.
I20251211 21:05:31.858702 4929 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 21:05:32.006387 4764 consensus_peers.cc:597] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d -> Peer c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): Couldn't send request to peer c8ee4a31e69b4bdfb62c0fc4337def61. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:37913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:32.121510 4929 consensus_queue.cc:1048] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 21:05:32.126040 4839 consensus_peers.cc:597] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb -> Peer c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): Couldn't send request to peer c8ee4a31e69b4bdfb62c0fc4337def61. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:37913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:32.133831 4922 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:32.247994 4929 consensus_queue.cc:1048] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 21:05:32.251690 4839 consensus_peers.cc:597] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb -> Peer c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): Couldn't send request to peer c8ee4a31e69b4bdfb62c0fc4337def61. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:37913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:32.332120 4929 consensus_queue.cc:1048] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 21:05:32.334928 4839 consensus_peers.cc:597] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb -> Peer c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): Couldn't send request to peer c8ee4a31e69b4bdfb62c0fc4337def61. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:37913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:32.596642 4922 consensus_queue.cc:579] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Leader has been unable to successfully communicate with peer c8ee4a31e69b4bdfb62c0fc4337def61 for more than 1 seconds (1.044s)
I20251211 21:05:32.729918 4981 consensus_queue.cc:579] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Leader has been unable to successfully communicate with peer c8ee4a31e69b4bdfb62c0fc4337def61 for more than 1 seconds (1.384s)
I20251211 21:05:32.817023 4619 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37870:
table { table_name: "dugtrio" } modify_external_catalogs: true
I20251211 21:05:32.817171 4619 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37870:
table { table_name: "dugtrio" } modify_external_catalogs: true
I20251211 21:05:32.820385 4619 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: Sending DeleteTablet for 3 replicas of tablet af852bf62bc24e33b6633d17972b0280
I20251211 21:05:32.820712 4619 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: Sending DeleteTablet for 3 replicas of tablet b92158a490f14334bd1b7f7b31a5fdf9
I20251211 21:05:32.820950 4619 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: Sending DeleteTablet for 3 replicas of tablet 6780adca868d4754b674f91b339c1ce7
I20251211 21:05:32.821035 4785 tablet_service.cc:1552] Processing DeleteTablet for tablet af852bf62bc24e33b6633d17972b0280 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:36462
I20251211 21:05:32.821166 4619 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: Sending DeleteTablet for 3 replicas of tablet c0538165eb5e4bfe9f76e053044f7985
I20251211 21:05:32.821349 4861 tablet_service.cc:1552] Processing DeleteTablet for tablet b92158a490f14334bd1b7f7b31a5fdf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:33950
I20251211 21:05:32.821349 4862 tablet_service.cc:1552] Processing DeleteTablet for tablet af852bf62bc24e33b6633d17972b0280 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:33950
I20251211 21:05:32.821388 4785 tablet_service.cc:1552] Processing DeleteTablet for tablet b92158a490f14334bd1b7f7b31a5fdf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:36462
I20251211 21:05:32.821954 4994 tablet_replica.cc:333] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: stopping tablet replica
I20251211 21:05:32.822129 4861 tablet_service.cc:1552] Processing DeleteTablet for tablet 6780adca868d4754b674f91b339c1ce7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:33950
I20251211 21:05:32.822155 4862 tablet_service.cc:1552] Processing DeleteTablet for tablet c0538165eb5e4bfe9f76e053044f7985 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:33950
I20251211 21:05:32.822249 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 21:05:32.822309 4785 tablet_service.cc:1552] Processing DeleteTablet for tablet 6780adca868d4754b674f91b339c1ce7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:36462
I20251211 21:05:32.822156 4993 tablet_replica.cc:333] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: stopping tablet replica
I20251211 21:05:32.822388 4786 tablet_service.cc:1552] Processing DeleteTablet for tablet c0538165eb5e4bfe9f76e053044f7985 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:36462
I20251211 21:05:32.822467 4993 raft_consensus.cc:2243] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.822584 4993 raft_consensus.cc:2272] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.822734 4994 raft_consensus.cc:2243] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:32.822937 4994 raft_consensus.cc:2272] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Raft consensus is shut down!
W20251211 21:05:32.823167 4606 catalog_manager.cc:4712] TS c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c0538165eb5e4bfe9f76e053044f7985: Network error: Client connection negotiation failed: client connection to 127.29.190.193:37913: connect: Connection refused (error 111)
I20251211 21:05:32.823378 4993 ts_tablet_manager.cc:1916] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.823525 4994 ts_tablet_manager.cc:1916] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251211 21:05:32.824750 4996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:32.825002 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:32.825141 4999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:32.824761 4997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:32.825439 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:32.825496 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:32.825516 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487132825516 us; error 0 us; skew 500 ppm
I20251211 21:05:32.825881 4994 ts_tablet_manager.cc:1929] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251211 21:05:32.825969 4993 ts_tablet_manager.cc:1929] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251211 21:05:32.825999 4994 log.cc:1199] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/b92158a490f14334bd1b7f7b31a5fdf9
I20251211 21:05:32.826043 4993 log.cc:1199] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/af852bf62bc24e33b6633d17972b0280
I20251211 21:05:32.826277 4994 ts_tablet_manager.cc:1950] T b92158a490f14334bd1b7f7b31a5fdf9 P fbac55e4da7c40488f577c7be5f9acfb: Deleting consensus metadata
I20251211 21:05:32.826313 4993 ts_tablet_manager.cc:1950] T af852bf62bc24e33b6633d17972b0280 P 965dd7fa3e144a568222c2753c9b030d: Deleting consensus metadata
I20251211 21:05:32.826607 30459 webserver.cc:492] Webserver started at http://127.29.190.196:44617/ using document root <none> and password file <none>
I20251211 21:05:32.826759 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:32.826810 30459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 21:05:32.826880 30459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 21:05:32.827024 4994 tablet_replica.cc:333] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: stopping tablet replica
I20251211 21:05:32.827097 4993 tablet_replica.cc:333] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: stopping tablet replica
I20251211 21:05:32.827167 4994 raft_consensus.cc:2243] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:32.827224 4605 catalog_manager.cc:4985] TS 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557): tablet af852bf62bc24e33b6633d17972b0280 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.827248 30459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-3-root/instance:
uuid: "6c0def99cc494e18a59cc958c684ab1c"
format_stamp: "Formatted at 2025-12-11 21:05:32 on dist-test-slave-xjj2"
I20251211 21:05:32.827401 4994 raft_consensus.cc:2272] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.827585 4606 catalog_manager.cc:4985] TS fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167): tablet b92158a490f14334bd1b7f7b31a5fdf9 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.827232 4993 raft_consensus.cc:2243] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.827857 4993 raft_consensus.cc:2272] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.828014 4994 ts_tablet_manager.cc:1916] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.828367 4993 ts_tablet_manager.cc:1916] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.828895 30459 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:32.829785 5004 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:32.830004 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:32.830065 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-3-root
uuid: "6c0def99cc494e18a59cc958c684ab1c"
format_stamp: "Formatted at 2025-12-11 21:05:32 on dist-test-slave-xjj2"
I20251211 21:05:32.830135 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:32.830116 4993 ts_tablet_manager.cc:1929] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251211 21:05:32.830116 4994 ts_tablet_manager.cc:1929] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251211 21:05:32.830236 4993 log.cc:1199] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/b92158a490f14334bd1b7f7b31a5fdf9
I20251211 21:05:32.830240 4994 log.cc:1199] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/af852bf62bc24e33b6633d17972b0280
I20251211 21:05:32.830511 4993 ts_tablet_manager.cc:1950] T b92158a490f14334bd1b7f7b31a5fdf9 P 965dd7fa3e144a568222c2753c9b030d: Deleting consensus metadata
I20251211 21:05:32.831461 4994 ts_tablet_manager.cc:1950] T af852bf62bc24e33b6633d17972b0280 P fbac55e4da7c40488f577c7be5f9acfb: Deleting consensus metadata
I20251211 21:05:32.831921 4993 tablet_replica.cc:333] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: stopping tablet replica
I20251211 21:05:32.832036 4993 raft_consensus.cc:2243] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.832072 4606 catalog_manager.cc:4985] TS fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167): tablet af852bf62bc24e33b6633d17972b0280 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.832044 4605 catalog_manager.cc:4985] TS 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557): tablet b92158a490f14334bd1b7f7b31a5fdf9 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.832157 4993 raft_consensus.cc:2272] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.832254 4994 tablet_replica.cc:333] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: stopping tablet replica
I20251211 21:05:32.832347 4994 raft_consensus.cc:2243] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:32.832517 4994 raft_consensus.cc:2272] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.832767 4993 ts_tablet_manager.cc:1916] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.832978 4994 ts_tablet_manager.cc:1916] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.834520 4994 ts_tablet_manager.cc:1929] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251211 21:05:32.834584 4994 log.cc:1199] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/6780adca868d4754b674f91b339c1ce7
I20251211 21:05:32.834676 4993 ts_tablet_manager.cc:1929] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251211 21:05:32.834748 4993 log.cc:1199] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/6780adca868d4754b674f91b339c1ce7
I20251211 21:05:32.834831 4994 ts_tablet_manager.cc:1950] T 6780adca868d4754b674f91b339c1ce7 P fbac55e4da7c40488f577c7be5f9acfb: Deleting consensus metadata
I20251211 21:05:32.834964 4993 ts_tablet_manager.cc:1950] T 6780adca868d4754b674f91b339c1ce7 P 965dd7fa3e144a568222c2753c9b030d: Deleting consensus metadata
I20251211 21:05:32.835431 4994 tablet_replica.cc:333] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: stopping tablet replica
I20251211 21:05:32.835578 4994 raft_consensus.cc:2243] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.835584 4606 catalog_manager.cc:4985] TS fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167): tablet 6780adca868d4754b674f91b339c1ce7 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.835672 4605 catalog_manager.cc:4985] TS 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557): tablet 6780adca868d4754b674f91b339c1ce7 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.835748 4994 raft_consensus.cc:2272] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.835875 4993 tablet_replica.cc:333] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: stopping tablet replica
I20251211 21:05:32.836016 4993 raft_consensus.cc:2243] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.836122 4993 raft_consensus.cc:2272] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.836134 4994 ts_tablet_manager.cc:1916] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.836470 4993 ts_tablet_manager.cc:1916] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.837656 4994 ts_tablet_manager.cc:1929] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251211 21:05:32.837719 4994 log.cc:1199] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/c0538165eb5e4bfe9f76e053044f7985
I20251211 21:05:32.837891 4994 ts_tablet_manager.cc:1950] T c0538165eb5e4bfe9f76e053044f7985 P fbac55e4da7c40488f577c7be5f9acfb: Deleting consensus metadata
I20251211 21:05:32.838174 4993 ts_tablet_manager.cc:1929] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251211 21:05:32.838239 4993 log.cc:1199] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/c0538165eb5e4bfe9f76e053044f7985
I20251211 21:05:32.838404 4993 ts_tablet_manager.cc:1950] T c0538165eb5e4bfe9f76e053044f7985 P 965dd7fa3e144a568222c2753c9b030d: Deleting consensus metadata
I20251211 21:05:32.838495 4606 catalog_manager.cc:4985] TS fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167): tablet c0538165eb5e4bfe9f76e053044f7985 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.838999 4605 catalog_manager.cc:4985] TS 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557): tablet c0538165eb5e4bfe9f76e053044f7985 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.845242 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:32.845731 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:32.846036 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:32.846566 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 21:05:32.846634 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:32.846678 30459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 21:05:32.846704 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:32.850796 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.196:43189
I20251211 21:05:32.851281 5067 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.196:43189 every 8 connection(s)
I20251211 21:05:32.851702 30459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 21:05:32.853524 5072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 21:05:32.853654 5071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:32.853811 30459 server_base.cc:1047] running on GCE node
W20251211 21:05:32.853897 5074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 21:05:32.854085 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 21:05:32.854159 30459 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 21:05:32.854183 30459 hybrid_clock.cc:648] HybridClock initialized: now 1765487132854183 us; error 0 us; skew 500 ppm
I20251211 21:05:32.855368 30459 webserver.cc:492] Webserver started at http://127.29.190.193:32953/ using document root <none> and password file <none>
I20251211 21:05:32.855535 30459 fs_manager.cc:362] Metadata directory not provided
I20251211 21:05:32.855584 30459 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 21:05:32.855993 5068 heartbeater.cc:344] Connected to a master server at 127.29.190.254:38075
I20251211 21:05:32.856089 5068 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:32.856341 5068 heartbeater.cc:507] Master 127.29.190.254:38075 requested a full tablet report, sending...
I20251211 21:05:32.856864 30459 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:32.856963 4619 ts_manager.cc:194] Registered new tserver with Master: 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196:43189)
I20251211 21:05:32.857513 4619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56284
I20251211 21:05:32.858022 5079 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 21:05:32.858268 30459 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251211 21:05:32.858333 30459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root
uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
format_stamp: "Formatted at 2025-12-11 21:05:30 on dist-test-slave-xjj2"
I20251211 21:05:32.858407 30459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 21:05:32.867168 4873 consensus_queue.cc:237] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:32.868878 4798 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:05:32.869287 4943 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251211 21:05:32.870002 4839 consensus_peers.cc:597] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb -> Peer c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): Couldn't send request to peer c8ee4a31e69b4bdfb62c0fc4337def61. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.193:37913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:32.870844 4929 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:32.872426 4606 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet d80de04737374f31a5caf1cbfd5a289a with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 3)
W20251211 21:05:32.873078 4839 consensus_peers.cc:597] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb -> Peer 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196:43189): Couldn't send request to peer 6c0def99cc494e18a59cc958c684ab1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d80de04737374f31a5caf1cbfd5a289a. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:32.873121 4798 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:32.873267 4619 catalog_manager.cc:5654] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb reported cstate change: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:32.877315 30459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 21:05:32.877624 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 21:05:32.877867 30459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 21:05:32.878439 5091 ts_tablet_manager.cc:542] Loading tablet metadata (0/8 complete)
I20251211 21:05:32.883821 30459 ts_tablet_manager.cc:585] Loaded tablet metadata (8 total tablets, 8 live tablets)
I20251211 21:05:32.883893 30459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20251211 21:05:32.883934 30459 ts_tablet_manager.cc:600] Registering tablets (0/8 complete)
I20251211 21:05:32.884718 5091 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:32.887540 5091 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 21:05:32.887884 5091 tablet_bootstrap.cc:492] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap complete.
I20251211 21:05:32.887957 30459 ts_tablet_manager.cc:616] Registered 8 tablets
I20251211 21:05:32.888015 30459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.004s sys 0.000s
I20251211 21:05:32.888068 5091 ts_tablet_manager.cc:1403] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20251211 21:05:32.888468 5091 raft_consensus.cc:359] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.888652 5091 raft_consensus.cc:740] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:32.888808 5091 consensus_queue.cc:260] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.889201 5091 ts_tablet_manager.cc:1434] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:32.889391 5091 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:32.892117 5091 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:32.892345 5091 tablet_bootstrap.cc:492] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap complete.
I20251211 21:05:32.892544 5091 ts_tablet_manager.cc:1403] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:32.892874 30459 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.193:37913
I20251211 21:05:32.892940 5151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.190.193:37913 every 8 connection(s)
I20251211 21:05:32.892959 5091 raft_consensus.cc:359] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.893100 5091 raft_consensus.cc:740] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:32.893236 5091 consensus_queue.cc:260] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.893481 5091 ts_tablet_manager.cc:1434] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:32.893667 5091 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:32.895990 5091 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:32.896209 5091 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap complete.
I20251211 21:05:32.896371 5091 ts_tablet_manager.cc:1403] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:32.896780 5091 raft_consensus.cc:359] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.896905 5091 raft_consensus.cc:740] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:32.897037 5091 consensus_queue.cc:260] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.897281 5091 ts_tablet_manager.cc:1434] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:32.897383 5152 heartbeater.cc:344] Connected to a master server at 127.29.190.254:38075
I20251211 21:05:32.897457 5091 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:32.897481 5152 heartbeater.cc:461] Registering TS with master...
I20251211 21:05:32.897701 5152 heartbeater.cc:507] Master 127.29.190.254:38075 requested a full tablet report, sending...
I20251211 21:05:32.898651 4617 ts_manager.cc:194] Re-registered known tserver with Master: c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913)
I20251211 21:05:32.899717 5091 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:32.899973 5091 tablet_bootstrap.cc:492] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap complete.
I20251211 21:05:32.900147 5091 ts_tablet_manager.cc:1403] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:32.900485 4617 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56294
I20251211 21:05:32.900597 5091 raft_consensus.cc:359] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.900710 5091 raft_consensus.cc:740] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:32.900857 5091 consensus_queue.cc:260] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.901130 5091 ts_tablet_manager.cc:1434] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:32.901307 5091 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:32.901443 5152 heartbeater.cc:499] Master 127.29.190.254:38075 was elected leader, sending a full tablet report...
I20251211 21:05:32.904636 5091 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:32.904915 5091 tablet_bootstrap.cc:492] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap complete.
I20251211 21:05:32.905107 5091 ts_tablet_manager.cc:1403] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:05:32.905560 5091 raft_consensus.cc:359] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.905690 5091 raft_consensus.cc:740] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:32.905827 5091 consensus_queue.cc:260] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.906097 5091 ts_tablet_manager.cc:1434] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:32.906140 5115 tablet_service.cc:1552] Processing DeleteTablet for tablet af852bf62bc24e33b6633d17972b0280 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:53250
I20251211 21:05:32.906272 5091 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:32.906509 5159 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:32.906687 5159 raft_consensus.cc:2243] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.906852 5159 raft_consensus.cc:2272] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.907343 5159 ts_tablet_manager.cc:1916] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.909431 5091 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 21:05:32.909752 5091 tablet_bootstrap.cc:492] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap complete.
I20251211 21:05:32.909868 5159 ts_tablet_manager.cc:1929] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251211 21:05:32.909926 5091 ts_tablet_manager.cc:1403] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251211 21:05:32.909940 5159 log.cc:1199] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/af852bf62bc24e33b6633d17972b0280
I20251211 21:05:32.910163 5159 ts_tablet_manager.cc:1950] T af852bf62bc24e33b6633d17972b0280 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting consensus metadata
I20251211 21:05:32.910403 5091 raft_consensus.cc:359] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.910557 5091 raft_consensus.cc:740] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:32.910696 5091 consensus_queue.cc:260] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.910869 4606 catalog_manager.cc:4985] TS c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): tablet af852bf62bc24e33b6633d17972b0280 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.910976 5091 ts_tablet_manager.cc:1434] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:32.911007 5115 tablet_service.cc:1552] Processing DeleteTablet for tablet b92158a490f14334bd1b7f7b31a5fdf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:53250
I20251211 21:05:32.911134 5091 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:32.911185 5159 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:32.911286 5159 raft_consensus.cc:2243] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.911374 5159 raft_consensus.cc:2272] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.911983 5159 ts_tablet_manager.cc:1916] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.913915 5091 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:32.914067 5159 ts_tablet_manager.cc:1929] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251211 21:05:32.914134 5159 log.cc:1199] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/b92158a490f14334bd1b7f7b31a5fdf9
I20251211 21:05:32.914149 5091 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap complete.
I20251211 21:05:32.914294 5091 ts_tablet_manager.cc:1403] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251211 21:05:32.914315 5159 ts_tablet_manager.cc:1950] T b92158a490f14334bd1b7f7b31a5fdf9 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting consensus metadata
I20251211 21:05:32.914871 5091 raft_consensus.cc:359] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.914990 5091 raft_consensus.cc:740] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:32.915108 4606 catalog_manager.cc:4985] TS c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): tablet b92158a490f14334bd1b7f7b31a5fdf9 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.915123 5091 consensus_queue.cc:260] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.915398 5091 ts_tablet_manager.cc:1434] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:32.915578 5091 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap starting.
I20251211 21:05:32.918327 5091 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 21:05:32.918586 5091 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Bootstrap complete.
I20251211 21:05:32.918743 5091 ts_tablet_manager.cc:1403] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251211 21:05:32.919123 5091 raft_consensus.cc:359] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.919260 5091 raft_consensus.cc:740] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee4a31e69b4bdfb62c0fc4337def61, State: Initialized, Role: FOLLOWER
I20251211 21:05:32.919387 5091 consensus_queue.cc:260] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.919710 5091 ts_tablet_manager.cc:1434] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:32.925366 5115 tablet_service.cc:1552] Processing DeleteTablet for tablet 6780adca868d4754b674f91b339c1ce7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:53250
I20251211 21:05:32.925598 5159 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:32.925755 5159 raft_consensus.cc:2243] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.925871 5159 raft_consensus.cc:2272] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.926375 5159 ts_tablet_manager.cc:1916] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.928184 5159 ts_tablet_manager.cc:1929] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251211 21:05:32.928256 5159 log.cc:1199] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/6780adca868d4754b674f91b339c1ce7
I20251211 21:05:32.928437 5159 ts_tablet_manager.cc:1950] T 6780adca868d4754b674f91b339c1ce7 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting consensus metadata
I20251211 21:05:32.929112 4606 catalog_manager.cc:4985] TS c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): tablet 6780adca868d4754b674f91b339c1ce7 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.943012 5115 tablet_service.cc:1552] Processing DeleteTablet for tablet c0538165eb5e4bfe9f76e053044f7985 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 21:05:32 UTC) from {username='slave'} at 127.0.0.1:53250
I20251211 21:05:32.943296 5159 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:32.943459 5159 raft_consensus.cc:2243] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:32.943503 4943 raft_consensus.cc:493] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:32.943575 5159 pending_rounds.cc:70] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Trying to abort 1 pending ops.
I20251211 21:05:32.943640 5159 pending_rounds.cc:77] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231435291620454400 op_type: NO_OP noop_request { }
I20251211 21:05:32.943599 4943 raft_consensus.cc:515] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.943712 5159 raft_consensus.cc:2889] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251211 21:05:32.943774 5159 raft_consensus.cc:2272] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:32.944056 4943 leader_election.cc:290] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:32.944393 5159 ts_tablet_manager.cc:1916] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 21:05:32.944425 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78bbbb9ac14e4bb89eb7b0e12ee7c0dd" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d" is_pre_election: true
I20251211 21:05:32.944538 4798 raft_consensus.cc:2468] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 1.
I20251211 21:05:32.944828 4838 leader_election.cc:304] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, fbac55e4da7c40488f577c7be5f9acfb; no voters:
I20251211 21:05:32.944985 4943 raft_consensus.cc:2804] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 21:05:32.945034 4943 raft_consensus.cc:493] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:32.945070 4943 raft_consensus.cc:3060] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:32.946059 4943 raft_consensus.cc:515] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.946460 4943 leader_election.cc:290] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 2 election: Requested vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:32.946784 5159 ts_tablet_manager.cc:1929] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251211 21:05:32.946884 5159 log.cc:1199] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/c0538165eb5e4bfe9f76e053044f7985
I20251211 21:05:32.946873 4798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78bbbb9ac14e4bb89eb7b0e12ee7c0dd" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965dd7fa3e144a568222c2753c9b030d"
I20251211 21:05:32.946990 4798 raft_consensus.cc:3060] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:32.947180 5159 ts_tablet_manager.cc:1950] T c0538165eb5e4bfe9f76e053044f7985 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting consensus metadata
I20251211 21:05:32.947585 5125 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78bbbb9ac14e4bb89eb7b0e12ee7c0dd" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" is_pre_election: true
I20251211 21:05:32.947638 5124 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78bbbb9ac14e4bb89eb7b0e12ee7c0dd" candidate_uuid: "fbac55e4da7c40488f577c7be5f9acfb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
I20251211 21:05:32.947757 5125 raft_consensus.cc:2410] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbac55e4da7c40488f577c7be5f9acfb for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251211 21:05:32.947902 4798 raft_consensus.cc:2468] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbac55e4da7c40488f577c7be5f9acfb in term 2.
I20251211 21:05:32.947908 4606 catalog_manager.cc:4985] TS c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): tablet c0538165eb5e4bfe9f76e053044f7985 (table dugtrio [id=3faaa3340e794225a47b2db44a3f2d46]) successfully deleted
I20251211 21:05:32.948166 4838 leader_election.cc:304] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, fbac55e4da7c40488f577c7be5f9acfb; no voters: c8ee4a31e69b4bdfb62c0fc4337def61
I20251211 21:05:32.948308 4943 raft_consensus.cc:2804] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:05:32.948392 4943 raft_consensus.cc:697] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 2 LEADER]: Becoming Leader. State: Replica: fbac55e4da7c40488f577c7be5f9acfb, State: Running, Role: LEADER
I20251211 21:05:32.948514 4943 consensus_queue.cc:237] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:32.949944 4617 catalog_manager.cc:5654] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb reported cstate change: term changed from 1 to 2, leader changed from c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193) to fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195). New cstate: current_term: 2 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:32.955034 4798 consensus_queue.cc:237] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:32.956923 4873 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 21:05:32.957345 4922 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:05:32.959048 4922 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:32.959357 4873 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:32.960867 4605 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 98076b3eee6842ffb67489077988aa60 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 5)
I20251211 21:05:32.960896 5124 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251211 21:05:32.960913 4764 consensus_peers.cc:597] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d -> Peer 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196:43189): Couldn't send request to peer 6c0def99cc494e18a59cc958c684ab1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98076b3eee6842ffb67489077988aa60. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:32.961385 4617 catalog_manager.cc:5654] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d reported cstate change: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:32.961558 4979 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:32.962719 5124 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
W20251211 21:05:32.997977 4668 auto_rebalancer.cc:253] failed to send replica move request: Invalid argument: Server with UUID 6c0def99cc494e18a59cc958c684ab1c is already a member of the config. RaftConfig: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
W20251211 21:05:32.998994 4668 auto_rebalancer.cc:663] Could not move replica: Illegal state: d80de04737374f31a5caf1cbfd5a289a: source replica 965dd7fa3e144a568222c2753c9b030d does not have REPLACE attribute set
W20251211 21:05:32.999056 4668 auto_rebalancer.cc:263] scheduled replica move failed to complete: Illegal state: d80de04737374f31a5caf1cbfd5a289a: source replica 965dd7fa3e144a568222c2753c9b030d does not have REPLACE attribute set
W20251211 21:05:33.000036 4668 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 5b81c60ef4e14f1182cd82bfc57e21e5, TS fbac55e4da7c40488f577c7be5f9acfb -> TS 6c0def99cc494e18a59cc958c684ab1c move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
W20251211 21:05:33.000092 4668 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 5b81c60ef4e14f1182cd82bfc57e21e5, TS fbac55e4da7c40488f577c7be5f9acfb -> TS 6c0def99cc494e18a59cc958c684ab1c move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
W20251211 21:05:33.000964 4668 auto_rebalancer.cc:663] Could not move replica: Illegal state: 98076b3eee6842ffb67489077988aa60: source replica c8ee4a31e69b4bdfb62c0fc4337def61 does not have REPLACE attribute set
W20251211 21:05:33.001011 4668 auto_rebalancer.cc:263] scheduled replica move failed to complete: Illegal state: 98076b3eee6842ffb67489077988aa60: source replica c8ee4a31e69b4bdfb62c0fc4337def61 does not have REPLACE attribute set
I20251211 21:05:33.008525 4979 raft_consensus.cc:493] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 21:05:33.008702 4979 raft_consensus.cc:515] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:33.009202 4979 leader_election.cc:290] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:33.009727 5124 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b81c60ef4e14f1182cd82bfc57e21e5" candidate_uuid: "965dd7fa3e144a568222c2753c9b030d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" is_pre_election: true
I20251211 21:05:33.009920 5124 raft_consensus.cc:2410] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 965dd7fa3e144a568222c2753c9b030d for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251211 21:05:33.010136 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b81c60ef4e14f1182cd82bfc57e21e5" candidate_uuid: "965dd7fa3e144a568222c2753c9b030d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb" is_pre_election: true
I20251211 21:05:33.010251 4873 raft_consensus.cc:2468] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 965dd7fa3e144a568222c2753c9b030d in term 1.
I20251211 21:05:33.010560 4764 leader_election.cc:304] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, fbac55e4da7c40488f577c7be5f9acfb; no voters: c8ee4a31e69b4bdfb62c0fc4337def61
I20251211 21:05:33.010753 4979 raft_consensus.cc:2804] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 21:05:33.010831 4979 raft_consensus.cc:493] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 21:05:33.010885 4979 raft_consensus.cc:3060] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:33.012105 4979 raft_consensus.cc:515] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:33.012504 4979 leader_election.cc:290] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [CANDIDATE]: Term 2 election: Requested vote from peers c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913), fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:33.012933 5124 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b81c60ef4e14f1182cd82bfc57e21e5" candidate_uuid: "965dd7fa3e144a568222c2753c9b030d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61"
I20251211 21:05:33.013044 5124 raft_consensus.cc:3060] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:33.013803 5124 raft_consensus.cc:2410] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 965dd7fa3e144a568222c2753c9b030d for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251211 21:05:33.014030 4873 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b81c60ef4e14f1182cd82bfc57e21e5" candidate_uuid: "965dd7fa3e144a568222c2753c9b030d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbac55e4da7c40488f577c7be5f9acfb"
I20251211 21:05:33.014130 4873 raft_consensus.cc:3060] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:33.014896 4873 raft_consensus.cc:2468] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 965dd7fa3e144a568222c2753c9b030d in term 2.
I20251211 21:05:33.015169 4764 leader_election.cc:304] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 965dd7fa3e144a568222c2753c9b030d, fbac55e4da7c40488f577c7be5f9acfb; no voters: c8ee4a31e69b4bdfb62c0fc4337def61
I20251211 21:05:33.015341 4979 raft_consensus.cc:2804] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 2 FOLLOWER]: Leader election won for term 2
I20251211 21:05:33.015424 4979 raft_consensus.cc:697] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 2 LEADER]: Becoming Leader. State: Replica: 965dd7fa3e144a568222c2753c9b030d, State: Running, Role: LEADER
I20251211 21:05:33.015564 4979 consensus_queue.cc:237] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:33.017244 4619 catalog_manager.cc:5654] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d reported cstate change: term changed from 1 to 2, leader changed from c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193) to 965dd7fa3e144a568222c2753c9b030d (127.29.190.194). New cstate: current_term: 2 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:33.355432 5170 ts_tablet_manager.cc:933] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Initiating tablet copy from peer 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:33.355783 5171 ts_tablet_manager.cc:933] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Initiating tablet copy from peer fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:33.355798 5170 tablet_copy_client.cc:323] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:46557
I20251211 21:05:33.356058 5171 tablet_copy_client.cc:323] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:42167
I20251211 21:05:33.359336 4808 tablet_copy_service.cc:140] P 965dd7fa3e144a568222c2753c9b030d: Received BeginTabletCopySession request for tablet 98076b3eee6842ffb67489077988aa60 from peer 6c0def99cc494e18a59cc958c684ab1c ({username='slave'} at 127.0.0.1:58704)
I20251211 21:05:33.359357 4883 tablet_copy_service.cc:140] P fbac55e4da7c40488f577c7be5f9acfb: Received BeginTabletCopySession request for tablet d80de04737374f31a5caf1cbfd5a289a from peer 6c0def99cc494e18a59cc958c684ab1c ({username='slave'} at 127.0.0.1:46882)
I20251211 21:05:33.359460 4808 tablet_copy_service.cc:161] P 965dd7fa3e144a568222c2753c9b030d: Beginning new tablet copy session on tablet 98076b3eee6842ffb67489077988aa60 from peer 6c0def99cc494e18a59cc958c684ab1c at {username='slave'} at 127.0.0.1:58704: session id = 6c0def99cc494e18a59cc958c684ab1c-98076b3eee6842ffb67489077988aa60
I20251211 21:05:33.359498 4883 tablet_copy_service.cc:161] P fbac55e4da7c40488f577c7be5f9acfb: Beginning new tablet copy session on tablet d80de04737374f31a5caf1cbfd5a289a from peer 6c0def99cc494e18a59cc958c684ab1c at {username='slave'} at 127.0.0.1:46882: session id = 6c0def99cc494e18a59cc958c684ab1c-d80de04737374f31a5caf1cbfd5a289a
I20251211 21:05:33.360308 4808 tablet_copy_source_session.cc:215] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:33.360363 4883 tablet_copy_source_session.cc:215] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:33.361106 5170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98076b3eee6842ffb67489077988aa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:33.361301 5171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80de04737374f31a5caf1cbfd5a289a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:33.363075 5170 tablet_copy_client.cc:806] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:33.363144 5171 tablet_copy_client.cc:806] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:33.363226 5170 tablet_copy_client.cc:670] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:33.363282 5171 tablet_copy_client.cc:670] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:33.364259 5170 tablet_copy_client.cc:538] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:33.364274 5171 tablet_copy_client.cc:538] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:33.365324 5170 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap starting.
I20251211 21:05:33.365337 5171 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap starting.
I20251211 21:05:33.368360 5170 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:33.368366 5171 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:33.368641 5170 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap complete.
I20251211 21:05:33.368645 5171 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap complete.
I20251211 21:05:33.368813 5170 ts_tablet_manager.cc:1403] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251211 21:05:33.368813 5171 ts_tablet_manager.cc:1403] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20251211 21:05:33.369338 5170 raft_consensus.cc:359] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:33.369338 5171 raft_consensus.cc:359] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:33.369505 5170 raft_consensus.cc:740] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c0def99cc494e18a59cc958c684ab1c, State: Initialized, Role: LEARNER
I20251211 21:05:33.369516 5171 raft_consensus.cc:740] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c0def99cc494e18a59cc958c684ab1c, State: Initialized, Role: LEARNER
I20251211 21:05:33.369630 5170 consensus_queue.cc:260] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:33.369639 5171 consensus_queue.cc:260] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:33.370021 5171 ts_tablet_manager.cc:1434] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 21:05:33.370025 5170 ts_tablet_manager.cc:1434] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251211 21:05:33.370069 5068 heartbeater.cc:499] Master 127.29.190.254:38075 was elected leader, sending a full tablet report...
I20251211 21:05:33.370573 4808 tablet_copy_service.cc:342] P 965dd7fa3e144a568222c2753c9b030d: Request end of tablet copy session 6c0def99cc494e18a59cc958c684ab1c-98076b3eee6842ffb67489077988aa60 received from {username='slave'} at 127.0.0.1:58704
I20251211 21:05:33.370656 4883 tablet_copy_service.cc:342] P fbac55e4da7c40488f577c7be5f9acfb: Request end of tablet copy session 6c0def99cc494e18a59cc958c684ab1c-d80de04737374f31a5caf1cbfd5a289a received from {username='slave'} at 127.0.0.1:46882
I20251211 21:05:33.370659 4808 tablet_copy_service.cc:434] P 965dd7fa3e144a568222c2753c9b030d: ending tablet copy session 6c0def99cc494e18a59cc958c684ab1c-98076b3eee6842ffb67489077988aa60 on tablet 98076b3eee6842ffb67489077988aa60 with peer 6c0def99cc494e18a59cc958c684ab1c
I20251211 21:05:33.370726 4883 tablet_copy_service.cc:434] P fbac55e4da7c40488f577c7be5f9acfb: ending tablet copy session 6c0def99cc494e18a59cc958c684ab1c-d80de04737374f31a5caf1cbfd5a289a on tablet d80de04737374f31a5caf1cbfd5a289a with peer 6c0def99cc494e18a59cc958c684ab1c
I20251211 21:05:33.382997 5124 raft_consensus.cc:3060] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Advancing to term 2
I20251211 21:05:33.384047 5124 raft_consensus.cc:1275] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20251211 21:05:33.384107 5124 pending_rounds.cc:85] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Aborting all ops after (but not including) 0
I20251211 21:05:33.384123 5124 pending_rounds.cc:107] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20251211 21:05:33.384150 5124 raft_consensus.cc:2889] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251211 21:05:33.384547 4943 consensus_queue.cc:1048] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:33.387054 4798 raft_consensus.cc:1275] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 2 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251211 21:05:33.387658 4943 consensus_queue.cc:1048] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:33.402809 4943 consensus_queue.cc:1050] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:33.404032 5124 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:33.412281 5124 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20251211 21:05:33.412374 5124 pending_rounds.cc:85] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Aborting all ops after (but not including) 0
I20251211 21:05:33.412390 5124 pending_rounds.cc:107] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20251211 21:05:33.412408 5124 raft_consensus.cc:2889] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251211 21:05:33.412806 4979 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:33.415158 4873 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251211 21:05:33.415766 4979 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 21:05:33.563504 4798 consensus_queue.cc:237] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:33.564639 5124 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:33.564692 4873 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:33.564994 4922 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:33.565119 4979 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:33.566565 4983 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } }
I20251211 21:05:33.567021 4873 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } }
I20251211 21:05:33.567021 5124 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } }
I20251211 21:05:33.568332 4605 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 98076b3eee6842ffb67489077988aa60 with cas_config_opid_index 2: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:33.569079 4617 catalog_manager.cc:5654] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d reported cstate change: config changed from index 2 to 3, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) evicted. New cstate: current_term: 1 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:33.574867 5032 tablet_service.cc:1552] Processing DeleteTablet for tablet 98076b3eee6842ffb67489077988aa60 with delete_type TABLET_DATA_TOMBSTONED (TS 6c0def99cc494e18a59cc958c684ab1c not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:40540
I20251211 21:05:33.575224 5193 tablet_replica.cc:333] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: stopping tablet replica
I20251211 21:05:33.575349 5193 raft_consensus.cc:2243] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Raft consensus shutting down.
I20251211 21:05:33.575459 5193 raft_consensus.cc:2272] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Raft consensus is shut down!
I20251211 21:05:33.576002 5193 ts_tablet_manager.cc:1916] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:05:33.577852 5193 ts_tablet_manager.cc:1929] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20251211 21:05:33.577924 5193 log.cc:1199] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-3-root/wals/98076b3eee6842ffb67489077988aa60
I20251211 21:05:33.578419 4606 catalog_manager.cc:4985] TS 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196:43189): tablet 98076b3eee6842ffb67489077988aa60 (table test-workload [id=24c60423bf534e35a54db9d692c60bf3]) successfully deleted
I20251211 21:05:33.766660 5042 raft_consensus.cc:1217] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251211 21:05:33.872674 4873 consensus_queue.cc:237] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } }
I20251211 21:05:33.873725 4798 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:33.873744 5124 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251211 21:05:33.874119 5194 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:33.874243 4981 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:33.875695 5194 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } }
I20251211 21:05:33.876153 5124 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } }
I20251211 21:05:33.876962 4798 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } }
I20251211 21:05:33.878350 4606 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d80de04737374f31a5caf1cbfd5a289a with cas_config_opid_index 2: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:33.878427 4617 catalog_manager.cc:5654] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb reported cstate change: config changed from index 2 to 3, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) evicted. New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } }
I20251211 21:05:33.880704 5032 tablet_service.cc:1552] Processing DeleteTablet for tablet d80de04737374f31a5caf1cbfd5a289a with delete_type TABLET_DATA_TOMBSTONED (TS 6c0def99cc494e18a59cc958c684ab1c not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:40540
I20251211 21:05:33.880898 5193 tablet_replica.cc:333] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: stopping tablet replica
I20251211 21:05:33.881006 5193 raft_consensus.cc:2243] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Raft consensus shutting down.
I20251211 21:05:33.881100 5193 raft_consensus.cc:2272] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Raft consensus is shut down!
I20251211 21:05:33.881470 5193 ts_tablet_manager.cc:1916] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:05:33.883230 5193 ts_tablet_manager.cc:1929] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20251211 21:05:33.883296 5193 log.cc:1199] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-3-root/wals/d80de04737374f31a5caf1cbfd5a289a
I20251211 21:05:33.883754 4606 catalog_manager.cc:4985] TS 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196:43189): tablet d80de04737374f31a5caf1cbfd5a289a (table test-workload [id=24c60423bf534e35a54db9d692c60bf3]) successfully deleted
I20251211 21:05:34.003590 4873 consensus_queue.cc:237] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:34.004897 5124 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:34.004906 4798 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20251211 21:05:34.005142 4839 consensus_peers.cc:597] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb -> Peer 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196:43189): Couldn't send request to peer 6c0def99cc494e18a59cc958c684ab1c. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:34.005287 4943 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:34.005513 5194 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:34.007015 4981 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.007408 4798 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.009028 5124 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.009500 4618 catalog_manager.cc:5654] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d reported cstate change: config changed from index 3 to 4, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.013693 4798 consensus_queue.cc:237] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:34.014818 4873 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251211 21:05:34.014899 5124 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251211 21:05:34.015062 4764 consensus_peers.cc:597] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d -> Peer 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196:43189): Couldn't send request to peer 6c0def99cc494e18a59cc958c684ab1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b81c60ef4e14f1182cd82bfc57e21e5. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:34.015269 4979 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:05:34.015422 4922 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251211 21:05:34.016819 4983 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.017220 5124 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.017256 4873 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.019312 4619 catalog_manager.cc:5654] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d reported cstate change: config changed from index -1 to 2, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New cstate: current_term: 2 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:34.019963 4798 consensus_queue.cc:237] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
W20251211 21:05:34.021236 4764 consensus_peers.cc:597] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d -> Peer 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196:43189): Couldn't send request to peer 6c0def99cc494e18a59cc958c684ab1c. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20251211 21:05:34.021287 5124 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:34.021631 4983 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:34.022347 4873 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251211 21:05:34.022680 4983 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:34.023020 4922 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.023452 5124 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.024289 4873 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } } }
I20251211 21:05:34.025785 4618 catalog_manager.cc:5654] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d reported cstate change: config changed from index 3 to 4, NON_VOTER 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) added. New cstate: current_term: 1 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 21:05:34.448060 5199 ts_tablet_manager.cc:933] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: Initiating tablet copy from peer 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:34.448398 5199 tablet_copy_client.cc:323] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:46557
I20251211 21:05:34.448776 4808 tablet_copy_service.cc:140] P 965dd7fa3e144a568222c2753c9b030d: Received BeginTabletCopySession request for tablet 5b81c60ef4e14f1182cd82bfc57e21e5 from peer 6c0def99cc494e18a59cc958c684ab1c ({username='slave'} at 127.0.0.1:58704)
I20251211 21:05:34.448881 4808 tablet_copy_service.cc:161] P 965dd7fa3e144a568222c2753c9b030d: Beginning new tablet copy session on tablet 5b81c60ef4e14f1182cd82bfc57e21e5 from peer 6c0def99cc494e18a59cc958c684ab1c at {username='slave'} at 127.0.0.1:58704: session id = 6c0def99cc494e18a59cc958c684ab1c-5b81c60ef4e14f1182cd82bfc57e21e5
I20251211 21:05:34.449774 4808 tablet_copy_source_session.cc:215] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:34.450562 5199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b81c60ef4e14f1182cd82bfc57e21e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:34.453006 5199 tablet_copy_client.cc:806] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:34.453153 5199 tablet_copy_client.cc:670] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:34.454173 5199 tablet_copy_client.cc:538] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:34.455363 5199 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap starting.
I20251211 21:05:34.458626 5199 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:34.458880 5199 tablet_bootstrap.cc:492] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap complete.
I20251211 21:05:34.459072 5199 ts_tablet_manager.cc:1403] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251211 21:05:34.459506 5199 raft_consensus.cc:359] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:34.459650 5199 raft_consensus.cc:740] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6c0def99cc494e18a59cc958c684ab1c, State: Initialized, Role: LEARNER
I20251211 21:05:34.459757 5199 consensus_queue.cc:260] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:34.460093 5199 ts_tablet_manager.cc:1434] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 21:05:34.460562 4808 tablet_copy_service.cc:342] P 965dd7fa3e144a568222c2753c9b030d: Request end of tablet copy session 6c0def99cc494e18a59cc958c684ab1c-5b81c60ef4e14f1182cd82bfc57e21e5 received from {username='slave'} at 127.0.0.1:58704
I20251211 21:05:34.460644 4808 tablet_copy_service.cc:434] P 965dd7fa3e144a568222c2753c9b030d: ending tablet copy session 6c0def99cc494e18a59cc958c684ab1c-5b81c60ef4e14f1182cd82bfc57e21e5 on tablet 5b81c60ef4e14f1182cd82bfc57e21e5 with peer 6c0def99cc494e18a59cc958c684ab1c
I20251211 21:05:34.461594 5199 ts_tablet_manager.cc:933] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Initiating tablet copy from peer fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167)
I20251211 21:05:34.461922 5199 tablet_copy_client.cc:323] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.195:42167
I20251211 21:05:34.462291 4883 tablet_copy_service.cc:140] P fbac55e4da7c40488f577c7be5f9acfb: Received BeginTabletCopySession request for tablet d80de04737374f31a5caf1cbfd5a289a from peer 6c0def99cc494e18a59cc958c684ab1c ({username='slave'} at 127.0.0.1:46882)
I20251211 21:05:34.462374 4883 tablet_copy_service.cc:161] P fbac55e4da7c40488f577c7be5f9acfb: Beginning new tablet copy session on tablet d80de04737374f31a5caf1cbfd5a289a from peer 6c0def99cc494e18a59cc958c684ab1c at {username='slave'} at 127.0.0.1:46882: session id = 6c0def99cc494e18a59cc958c684ab1c-d80de04737374f31a5caf1cbfd5a289a
I20251211 21:05:34.463183 4883 tablet_copy_source_session.cc:215] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:34.463750 5199 ts_tablet_manager.cc:1916] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Deleting tablet data with delete state TABLET_DATA_COPYING
I20251211 21:05:34.465626 5199 ts_tablet_manager.cc:1929] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.2
I20251211 21:05:34.465785 5199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80de04737374f31a5caf1cbfd5a289a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:34.466703 5199 tablet_copy_client.cc:806] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:34.466838 5199 tablet_copy_client.cc:670] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:34.467860 5199 tablet_copy_client.cc:538] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:34.468973 5199 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap starting.
I20251211 21:05:34.473088 5199 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:34.473323 5199 tablet_bootstrap.cc:492] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap complete.
I20251211 21:05:34.473490 5199 ts_tablet_manager.cc:1403] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251211 21:05:34.473919 5199 raft_consensus.cc:359] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:34.474022 5199 raft_consensus.cc:740] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c0def99cc494e18a59cc958c684ab1c, State: Initialized, Role: LEARNER
I20251211 21:05:34.474105 5199 consensus_queue.cc:260] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:34.474713 5199 ts_tablet_manager.cc:1434] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251211 21:05:34.475121 4883 tablet_copy_service.cc:342] P fbac55e4da7c40488f577c7be5f9acfb: Request end of tablet copy session 6c0def99cc494e18a59cc958c684ab1c-d80de04737374f31a5caf1cbfd5a289a received from {username='slave'} at 127.0.0.1:46882
I20251211 21:05:34.475203 4883 tablet_copy_service.cc:434] P fbac55e4da7c40488f577c7be5f9acfb: ending tablet copy session 6c0def99cc494e18a59cc958c684ab1c-d80de04737374f31a5caf1cbfd5a289a on tablet d80de04737374f31a5caf1cbfd5a289a with peer 6c0def99cc494e18a59cc958c684ab1c
I20251211 21:05:34.551633 5199 ts_tablet_manager.cc:933] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Initiating tablet copy from peer 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557)
I20251211 21:05:34.551995 5199 tablet_copy_client.cc:323] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.194:46557
I20251211 21:05:34.552419 4808 tablet_copy_service.cc:140] P 965dd7fa3e144a568222c2753c9b030d: Received BeginTabletCopySession request for tablet 98076b3eee6842ffb67489077988aa60 from peer 6c0def99cc494e18a59cc958c684ab1c ({username='slave'} at 127.0.0.1:58704)
I20251211 21:05:34.552522 4808 tablet_copy_service.cc:161] P 965dd7fa3e144a568222c2753c9b030d: Beginning new tablet copy session on tablet 98076b3eee6842ffb67489077988aa60 from peer 6c0def99cc494e18a59cc958c684ab1c at {username='slave'} at 127.0.0.1:58704: session id = 6c0def99cc494e18a59cc958c684ab1c-98076b3eee6842ffb67489077988aa60
I20251211 21:05:34.553520 4808 tablet_copy_source_session.cc:215] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 21:05:34.554105 5199 ts_tablet_manager.cc:1916] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Deleting tablet data with delete state TABLET_DATA_COPYING
I20251211 21:05:34.556345 5199 ts_tablet_manager.cc:1929] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.2
I20251211 21:05:34.556504 5199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98076b3eee6842ffb67489077988aa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 21:05:34.557407 5199 tablet_copy_client.cc:806] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 0 data blocks...
I20251211 21:05:34.557545 5199 tablet_copy_client.cc:670] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Starting download of 1 WAL segments...
I20251211 21:05:34.558475 5199 tablet_copy_client.cc:538] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 21:05:34.559834 5199 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap starting.
I20251211 21:05:34.564100 5199 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 21:05:34.564364 5199 tablet_bootstrap.cc:492] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Bootstrap complete.
I20251211 21:05:34.564545 5199 ts_tablet_manager.cc:1403] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251211 21:05:34.565022 5199 raft_consensus.cc:359] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:34.565155 5199 raft_consensus.cc:740] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c0def99cc494e18a59cc958c684ab1c, State: Initialized, Role: LEARNER
I20251211 21:05:34.565259 5199 consensus_queue.cc:260] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: NON_VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: true } }
I20251211 21:05:34.565521 5199 ts_tablet_manager.cc:1434] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 21:05:34.565930 4808 tablet_copy_service.cc:342] P 965dd7fa3e144a568222c2753c9b030d: Request end of tablet copy session 6c0def99cc494e18a59cc958c684ab1c-98076b3eee6842ffb67489077988aa60 received from {username='slave'} at 127.0.0.1:58704
I20251211 21:05:34.566017 4808 tablet_copy_service.cc:434] P 965dd7fa3e144a568222c2753c9b030d: ending tablet copy session 6c0def99cc494e18a59cc958c684ab1c-98076b3eee6842ffb67489077988aa60 on tablet 98076b3eee6842ffb67489077988aa60 with peer 6c0def99cc494e18a59cc958c684ab1c
I20251211 21:05:34.854617 5042 raft_consensus.cc:1217] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20251211 21:05:34.890262 5042 raft_consensus.cc:1217] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20251211 21:05:35.033768 5042 raft_consensus.cc:1217] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20251211 21:05:35.250352 5207 raft_consensus.cc:1064] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: attempting to promote NON_VOTER 6c0def99cc494e18a59cc958c684ab1c to VOTER
I20251211 21:05:35.250855 5207 consensus_queue.cc:237] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } }
I20251211 21:05:35.252209 5042 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251211 21:05:35.252170 4797 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251211 21:05:35.252170 5124 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251211 21:05:35.252583 5208 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251211 21:05:35.252794 5207 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251211 21:05:35.252971 5194 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251211 21:05:35.255056 5194 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.255429 5124 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.256803 5042 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.257472 4619 catalog_manager.cc:5654] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb reported cstate change: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:05:35.257679 4797 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.261955 4873 consensus_queue.cc:237] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } }
I20251211 21:05:35.263212 5042 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20251211 21:05:35.263278 5124 raft_consensus.cc:1275] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Refusing update from remote peer fbac55e4da7c40488f577c7be5f9acfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20251211 21:05:35.263633 5208 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251211 21:05:35.263958 5194 consensus_queue.cc:1048] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251211 21:05:35.265111 5212 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 965dd7fa3e144a568222c2753c9b030d (127.29.190.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.265538 5124 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 965dd7fa3e144a568222c2753c9b030d (127.29.190.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.266628 4606 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d80de04737374f31a5caf1cbfd5a289a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:35.267482 5042 raft_consensus.cc:2955] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 965dd7fa3e144a568222c2753c9b030d (127.29.190.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.267647 4618 catalog_manager.cc:5654] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 reported cstate change: config changed from index 5 to 6, VOTER 965dd7fa3e144a568222c2753c9b030d (127.29.190.194) evicted. New cstate: current_term: 1 leader_uuid: "fbac55e4da7c40488f577c7be5f9acfb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.269948 4786 tablet_service.cc:1552] Processing DeleteTablet for tablet d80de04737374f31a5caf1cbfd5a289a with delete_type TABLET_DATA_TOMBSTONED (TS 965dd7fa3e144a568222c2753c9b030d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36462
I20251211 21:05:35.270327 5221 tablet_replica.cc:333] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: stopping tablet replica
I20251211 21:05:35.270536 5221 raft_consensus.cc:2243] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:35.270784 5221 raft_consensus.cc:2272] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:35.271327 5221 ts_tablet_manager.cc:1916] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:05:35.273429 5221 ts_tablet_manager.cc:1929] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20251211 21:05:35.273509 5221 log.cc:1199] T d80de04737374f31a5caf1cbfd5a289a P 965dd7fa3e144a568222c2753c9b030d: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-1-root/wals/d80de04737374f31a5caf1cbfd5a289a
I20251211 21:05:35.273891 4605 catalog_manager.cc:4985] TS 965dd7fa3e144a568222c2753c9b030d (127.29.190.194:46557): tablet d80de04737374f31a5caf1cbfd5a289a (table test-workload [id=24c60423bf534e35a54db9d692c60bf3]) successfully deleted
I20251211 21:05:35.376816 5210 raft_consensus.cc:1064] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d: attempting to promote NON_VOTER 6c0def99cc494e18a59cc958c684ab1c to VOTER
I20251211 21:05:35.377271 5210 consensus_queue.cc:237] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } }
I20251211 21:05:35.378616 5042 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 LEARNER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251211 21:05:35.378681 4873 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251211 21:05:35.378751 5124 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251211 21:05:35.379014 5223 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:35.379194 5209 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:35.379494 4979 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251211 21:05:35.381170 5210 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.382776 5042 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.383028 5124 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.384783 4873 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.385475 4617 catalog_manager.cc:5654] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c reported cstate change: config changed from index 2 to 3, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } attrs { replace: true } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.388895 4797 consensus_queue.cc:237] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } }
I20251211 21:05:35.389937 5042 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251211 21:05:35.390268 5210 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:35.390369 5124 raft_consensus.cc:1275] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251211 21:05:35.390787 5210 consensus_queue.cc:1048] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251211 21:05:35.391711 5209 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.392093 5042 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.393275 4605 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 5b81c60ef4e14f1182cd82bfc57e21e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:35.394003 4618 catalog_manager.cc:5654] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c reported cstate change: config changed from index 3 to 4, VOTER fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195) evicted. New cstate: current_term: 2 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.394446 5124 raft_consensus.cc:2955] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } } peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.396752 4862 tablet_service.cc:1552] Processing DeleteTablet for tablet 5b81c60ef4e14f1182cd82bfc57e21e5 with delete_type TABLET_DATA_TOMBSTONED (TS fbac55e4da7c40488f577c7be5f9acfb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33950
I20251211 21:05:35.397631 5227 tablet_replica.cc:333] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: stopping tablet replica
I20251211 21:05:35.397769 5227 raft_consensus.cc:2243] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:35.397931 5227 raft_consensus.cc:2272] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:35.398576 5227 ts_tablet_manager.cc:1916] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:05:35.400444 5227 ts_tablet_manager.cc:1929] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20251211 21:05:35.400516 5227 log.cc:1199] T 5b81c60ef4e14f1182cd82bfc57e21e5 P fbac55e4da7c40488f577c7be5f9acfb: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-2-root/wals/5b81c60ef4e14f1182cd82bfc57e21e5
I20251211 21:05:35.400964 4606 catalog_manager.cc:4985] TS fbac55e4da7c40488f577c7be5f9acfb (127.29.190.195:42167): tablet 5b81c60ef4e14f1182cd82bfc57e21e5 (table test-workload [id=24c60423bf534e35a54db9d692c60bf3]) successfully deleted
I20251211 21:05:35.571625 4979 raft_consensus.cc:1064] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: attempting to promote NON_VOTER 6c0def99cc494e18a59cc958c684ab1c to VOTER
I20251211 21:05:35.572058 4979 consensus_queue.cc:237] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } }
I20251211 21:05:35.573333 4873 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251211 21:05:35.573333 5042 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 LEARNER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251211 21:05:35.573333 5124 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251211 21:05:35.573819 5209 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251211 21:05:35.574004 4979 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251211 21:05:35.574287 5210 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251211 21:05:35.576858 5223 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.577229 5042 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.577229 4873 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.579031 5124 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.579388 4616 catalog_manager.cc:5654] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c reported cstate change: config changed from index 4 to 5, 6c0def99cc494e18a59cc958c684ab1c (127.29.190.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "c8ee4a31e69b4bdfb62c0fc4337def61" member_type: VOTER last_known_addr { host: "127.29.190.193" port: 37913 } attrs { replace: true } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.583022 4797 consensus_queue.cc:237] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } }
I20251211 21:05:35.584326 5042 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20251211 21:05:35.584647 4873 raft_consensus.cc:1275] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Refusing update from remote peer 965dd7fa3e144a568222c2753c9b030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20251211 21:05:35.584688 5223 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251211 21:05:35.584960 5210 consensus_queue.cc:1048] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251211 21:05:35.586023 5223 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.586710 5042 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.586844 4873 raft_consensus.cc:2955] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } } }
I20251211 21:05:35.587779 4605 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 98076b3eee6842ffb67489077988aa60 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251211 21:05:35.588830 4619 catalog_manager.cc:5654] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d reported cstate change: config changed from index 5 to 6, VOTER c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193) evicted. New cstate: current_term: 1 leader_uuid: "965dd7fa3e144a568222c2753c9b030d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "965dd7fa3e144a568222c2753c9b030d" member_type: VOTER last_known_addr { host: "127.29.190.194" port: 46557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbac55e4da7c40488f577c7be5f9acfb" member_type: VOTER last_known_addr { host: "127.29.190.195" port: 42167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0def99cc494e18a59cc958c684ab1c" member_type: VOTER last_known_addr { host: "127.29.190.196" port: 43189 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251211 21:05:35.591038 5115 tablet_service.cc:1552] Processing DeleteTablet for tablet 98076b3eee6842ffb67489077988aa60 with delete_type TABLET_DATA_TOMBSTONED (TS c8ee4a31e69b4bdfb62c0fc4337def61 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53250
I20251211 21:05:35.591449 5232 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:35.591635 5232 raft_consensus.cc:2243] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:35.591912 5232 raft_consensus.cc:2272] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:35.592437 5232 ts_tablet_manager.cc:1916] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 21:05:35.594219 5232 ts_tablet_manager.cc:1929] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20251211 21:05:35.594286 5232 log.cc:1199] T 98076b3eee6842ffb67489077988aa60 P c8ee4a31e69b4bdfb62c0fc4337def61: Deleting WAL directory at /tmp/dist-test-taskYhI12k/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765486953797919-30459-0/minicluster-data/ts-0-root/wals/98076b3eee6842ffb67489077988aa60
I20251211 21:05:35.594739 4606 catalog_manager.cc:4985] TS c8ee4a31e69b4bdfb62c0fc4337def61 (127.29.190.193:37913): tablet 98076b3eee6842ffb67489077988aa60 (table test-workload [id=24c60423bf534e35a54db9d692c60bf3]) successfully deleted
I20251211 21:05:36.534698 30459 tablet_server.cc:178] TabletServer@127.29.190.193:37913 shutting down...
I20251211 21:05:36.537948 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:36.538144 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:36.538264 30459 raft_consensus.cc:2243] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:36.538417 30459 raft_consensus.cc:2272] T 5b81c60ef4e14f1182cd82bfc57e21e5 P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.538900 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:36.538986 30459 raft_consensus.cc:2243] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:36.539114 30459 raft_consensus.cc:2272] T d80de04737374f31a5caf1cbfd5a289a P c8ee4a31e69b4bdfb62c0fc4337def61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.539435 30459 tablet_replica.cc:333] stopping tablet replica
I20251211 21:05:36.539638 30459 raft_consensus.cc:2243] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:36.539762 30459 raft_consensus.cc:2272] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P c8ee4a31e69b4bdfb62c0fc4337def61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.552466 30459 tablet_server.cc:195] TabletServer@127.29.190.193:37913 shutdown complete.
I20251211 21:05:36.555222 30459 tablet_server.cc:178] TabletServer@127.29.190.194:0 shutting down...
I20251211 21:05:36.558843 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:36.559120 30459 tablet_replica.cc:333] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d: stopping tablet replica
I20251211 21:05:36.559231 30459 raft_consensus.cc:2243] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:05:36.559443 30459 raft_consensus.cc:2272] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 965dd7fa3e144a568222c2753c9b030d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.559914 30459 tablet_replica.cc:333] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d: stopping tablet replica
I20251211 21:05:36.559993 30459 raft_consensus.cc:2243] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:36.560120 30459 raft_consensus.cc:2272] T 98076b3eee6842ffb67489077988aa60 P 965dd7fa3e144a568222c2753c9b030d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.560561 30459 tablet_replica.cc:333] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d: stopping tablet replica
I20251211 21:05:36.560633 30459 raft_consensus.cc:2243] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:36.560701 30459 raft_consensus.cc:2272] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P 965dd7fa3e144a568222c2753c9b030d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.573608 30459 tablet_server.cc:195] TabletServer@127.29.190.194:0 shutdown complete.
I20251211 21:05:36.576347 30459 tablet_server.cc:178] TabletServer@127.29.190.195:0 shutting down...
I20251211 21:05:36.580279 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:36.580462 30459 tablet_replica.cc:333] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb: stopping tablet replica
I20251211 21:05:36.580562 30459 raft_consensus.cc:2243] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:36.580750 30459 raft_consensus.cc:2272] T d80de04737374f31a5caf1cbfd5a289a P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.581143 30459 tablet_replica.cc:333] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb: stopping tablet replica
I20251211 21:05:36.581223 30459 raft_consensus.cc:2243] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 2 LEADER]: Raft consensus shutting down.
I20251211 21:05:36.581401 30459 raft_consensus.cc:2272] T 78bbbb9ac14e4bb89eb7b0e12ee7c0dd P fbac55e4da7c40488f577c7be5f9acfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.581713 30459 tablet_replica.cc:333] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb: stopping tablet replica
I20251211 21:05:36.581776 30459 raft_consensus.cc:2243] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:36.581875 30459 raft_consensus.cc:2272] T 98076b3eee6842ffb67489077988aa60 P fbac55e4da7c40488f577c7be5f9acfb [term 1 FOLLOWER]: Raft consensus is shut down!
W20251211 21:05:36.588893 4668 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver c8ee4a31e69b4bdfb62c0fc4337def61 not available for placement
I20251211 21:05:36.595654 30459 tablet_server.cc:195] TabletServer@127.29.190.195:0 shutdown complete.
I20251211 21:05:36.598006 30459 tablet_server.cc:178] TabletServer@127.29.190.196:0 shutting down...
I20251211 21:05:36.601270 30459 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 21:05:36.601449 30459 tablet_replica.cc:333] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c: stopping tablet replica
I20251211 21:05:36.601557 30459 raft_consensus.cc:2243] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:36.601676 30459 raft_consensus.cc:2272] T 98076b3eee6842ffb67489077988aa60 P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.602061 30459 tablet_replica.cc:333] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c: stopping tablet replica
I20251211 21:05:36.602140 30459 raft_consensus.cc:2243] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:36.602227 30459 raft_consensus.cc:2272] T d80de04737374f31a5caf1cbfd5a289a P 6c0def99cc494e18a59cc958c684ab1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.602496 30459 tablet_replica.cc:333] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c: stopping tablet replica
I20251211 21:05:36.602559 30459 raft_consensus.cc:2243] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 21:05:36.602648 30459 raft_consensus.cc:2272] T 5b81c60ef4e14f1182cd82bfc57e21e5 P 6c0def99cc494e18a59cc958c684ab1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.615073 30459 tablet_server.cc:195] TabletServer@127.29.190.196:0 shutdown complete.
I20251211 21:05:36.617205 30459 master.cc:561] Master@127.29.190.254:38075 shutting down...
I20251211 21:05:36.621037 30459 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 1 LEADER]: Raft consensus shutting down.
I20251211 21:05:36.621188 30459 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 21:05:36.621237 30459 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6b98c5f505da4dcaaa2b9481c238e269: stopping tablet replica
I20251211 21:05:36.633589 30459 master.cc:583] Master@127.29.190.254:38075 shutdown complete.
[ OK ] AutoRebalancerTest.TestDeletedTables (6689 ms)
[----------] 14 tests from AutoRebalancerTest (182833 ms total)
[----------] Global test environment tear-down
[==========] 14 tests from 1 test suite ran. (182833 ms total)
[ PASSED ] 13 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] AutoRebalancerTest.TestMaxMovesPerServer
1 FAILED TEST
I20251211 21:05:36.641489 30459 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 7 messages since previous log ~3 seconds ago
I20251211 21:05:36.641530 30459 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 7 messages since previous log ~3 seconds ago
I20251211 21:05:36.641546 30459 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/catalog_manager.cc:4712: suppressed but not reported on 7 messages since previous log ~3 seconds ago
I20251211 21:05:36.641566 30459 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/catalog_manager.cc:5332: suppressed but not reported on 10 messages since previous log ~29 seconds ago
I20251211 21:05:36.641590 30459 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 10 messages since previous log ~169 seconds ago
I20251211 21:05:36.641610 30459 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tablet/tablet.cc:2378: suppressed but not reported on 47 messages since previous log ~16 seconds ago
I20251211 21:05:36.641674 30459 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 21 messages since previous log ~6 seconds ago