[==========] Running 14 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 14 tests from AutoRebalancerTest
[ RUN ] AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251214 21:01:42.925463 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:38305,127.20.32.61:42669,127.20.32.60:34609
I20251214 21:01:42.926716 20608 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:01:42.927250 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:42.934975 20616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:42.935099 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:42.935205 20613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:42.935334 20614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:42.936048 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:42.936163 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:42.936197 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746102936195 us; error 0 us; skew 500 ppm
I20251214 21:01:42.938504 20608 webserver.cc:492] Webserver started at http://127.20.32.62:37451/ using document root <none> and password file <none>
I20251214 21:01:42.939101 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:42.939165 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:42.939374 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:42.941136 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d"
format_stamp: "Formatted at 2025-12-14 21:01:42 on dist-test-slave-bphs"
I20251214 21:01:42.945102 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20251214 21:01:42.947677 20621 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:42.949008 20608 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:42.949126 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d"
format_stamp: "Formatted at 2025-12-14 21:01:42 on dist-test-slave-bphs"
I20251214 21:01:42.949251 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:42.976441 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:42.977137 20608 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:01:42.977284 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:42.984745 20673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:38305 every 8 connection(s)
I20251214 21:01:42.984755 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:38305
I20251214 21:01:42.986164 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:42.988170 20679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:42.988298 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:42.988153 20676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:42.988142 20677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:42.988663 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:42.988721 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:42.988740 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746102988740 us; error 0 us; skew 500 ppm
I20251214 21:01:42.988950 20674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:42.989691 20608 webserver.cc:492] Webserver started at http://127.20.32.61:44451/ using document root <none> and password file <none>
I20251214 21:01:42.989861 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:42.989910 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:42.989975 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:42.990413 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root/instance:
uuid: "cca52670587547feb145d012ed004f78"
format_stamp: "Formatted at 2025-12-14 21:01:42 on dist-test-slave-bphs"
I20251214 21:01:42.992146 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:01:42.993203 20684 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:42.993469 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:42.993541 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root
uuid: "cca52670587547feb145d012ed004f78"
format_stamp: "Formatted at 2025-12-14 21:01:42 on dist-test-slave-bphs"
I20251214 21:01:42.993603 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:42.994062 20674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:43.005295 20674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
W20251214 21:01:43.006215 20625 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.32.61:42669: connect: Connection refused (error 111)
W20251214 21:01:43.009496 20674 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.32.61:42669: Network error: Client connection negotiation failed: client connection to 127.20.32.61:42669: connect: Connection refused (error 111)
I20251214 21:01:43.014688 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:43.015100 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:43.019837 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.61:42669
I20251214 21:01:43.019882 20739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.61:42669 every 8 connection(s)
I20251214 21:01:43.020493 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:01:43.020699 20740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:43.022018 20740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } has no permanent_uuid. Determining permanent_uuid...
W20251214 21:01:43.022310 20743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:43.022419 20745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:43.022498 20742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:43.022643 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:43.022814 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:43.022850 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:43.022871 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746103022870 us; error 0 us; skew 500 ppm
I20251214 21:01:43.023815 20608 webserver.cc:492] Webserver started at http://127.20.32.60:42291/ using document root <none> and password file <none>
I20251214 21:01:43.023957 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:43.024012 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:43.024084 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:43.024511 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root/instance:
uuid: "09ca5a700c544e2fa7681c17b209db73"
format_stamp: "Formatted at 2025-12-14 21:01:43 on dist-test-slave-bphs"
I20251214 21:01:43.026153 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:43.026814 20740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:43.027437 20751 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.027740 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:43.027812 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root
uuid: "09ca5a700c544e2fa7681c17b209db73"
format_stamp: "Formatted at 2025-12-14 21:01:43 on dist-test-slave-bphs"
I20251214 21:01:43.027877 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:43.031174 20740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } has no permanent_uuid. Determining permanent_uuid...
W20251214 21:01:43.032449 20740 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.32.60:34609: Network error: Client connection negotiation failed: client connection to 127.20.32.60:34609: connect: Connection refused (error 111)
I20251214 21:01:43.037506 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:43.037966 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:43.043259 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.60:34609
I20251214 21:01:43.043334 20805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.60:34609 every 8 connection(s)
I20251214 21:01:43.043717 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:01:43.044191 20806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:43.045300 20806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:43.050060 20806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:43.054545 20806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:43.058743 20674 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } attempt: 1
I20251214 21:01:43.061008 20806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: Bootstrap starting.
I20251214 21:01:43.062479 20674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:43.063859 20806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:43.064801 20806 log.cc:826] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: Log is configured to *not* fsync() on all Append() calls
I20251214 21:01:43.066767 20806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: No bootstrap required, opened a new log
I20251214 21:01:43.067179 20674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d: Bootstrap starting.
I20251214 21:01:43.068194 20674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:43.069406 20674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d: No bootstrap required, opened a new log
I20251214 21:01:43.069999 20806 raft_consensus.cc:359] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.070181 20806 raft_consensus.cc:385] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:43.070252 20806 raft_consensus.cc:740] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ca5a700c544e2fa7681c17b209db73, State: Initialized, Role: FOLLOWER
I20251214 21:01:43.070226 20674 raft_consensus.cc:359] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.070318 20674 raft_consensus.cc:385] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:43.070364 20674 raft_consensus.cc:740] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad0df1ba2234c6ba8d21572a1e2ad0d, State: Initialized, Role: FOLLOWER
I20251214 21:01:43.070712 20806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.070712 20674 consensus_queue.cc:260] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.071269 20813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.071686 20813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:43.071583 20812 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.071825 20812 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:43.071959 20806 sys_catalog.cc:565] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:01:43.071959 20674 sys_catalog.cc:565] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:01:43.074455 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20251214 21:01:43.077000 20834 catalog_manager.cc:1568] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251214 21:01:43.077080 20834 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20251214 21:01:43.077647 20835 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251214 21:01:43.077723 20835 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251214 21:01:43.084625 20740 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } attempt: 1
I20251214 21:01:43.090216 20740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78: Bootstrap starting.
I20251214 21:01:43.091391 20740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:43.092725 20740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78: No bootstrap required, opened a new log
I20251214 21:01:43.093255 20740 raft_consensus.cc:359] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.093381 20740 raft_consensus.cc:385] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:43.093422 20740 raft_consensus.cc:740] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca52670587547feb145d012ed004f78, State: Initialized, Role: FOLLOWER
I20251214 21:01:43.093569 20740 consensus_queue.cc:260] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.094267 20838 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.094376 20838 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:43.094463 20740 sys_catalog.cc:565] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:01:43.096402 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20251214 21:01:43.097069 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:43.097112 20849 catalog_manager.cc:1568] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251214 21:01:43.097204 20849 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20251214 21:01:43.099581 20850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:43.099581 20851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:43.099584 20853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:43.101851 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:43.102116 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:43.102171 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:43.102187 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746103102187 us; error 0 us; skew 500 ppm
I20251214 21:01:43.103195 20608 webserver.cc:492] Webserver started at http://127.20.32.1:46281/ using document root <none> and password file <none>
I20251214 21:01:43.103339 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:43.103387 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:43.103461 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:43.103848 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "f688e7c1b98a4c9b9e33be624651c801"
format_stamp: "Formatted at 2025-12-14 21:01:43 on dist-test-slave-bphs"
I20251214 21:01:43.105269 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:01:43.106207 20858 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.106470 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:43.106536 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "f688e7c1b98a4c9b9e33be624651c801"
format_stamp: "Formatted at 2025-12-14 21:01:43 on dist-test-slave-bphs"
I20251214 21:01:43.106613 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:43.113492 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:43.114462 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:43.114926 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:43.115871 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:43.115936 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.115978 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:43.116007 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.122994 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:38935
I20251214 21:01:43.123035 20921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:38935 every 8 connection(s)
I20251214 21:01:43.124130 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:43.127857 20929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:43.129585 20923 heartbeater.cc:344] Connected to a master server at 127.20.32.62:38305
I20251214 21:01:43.129801 20923 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.130100 20922 heartbeater.cc:344] Connected to a master server at 127.20.32.60:34609
I20251214 21:01:43.130177 20922 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.130496 20923 heartbeater.cc:507] Master 127.20.32.62:38305 requested a full tablet report, sending...
I20251214 21:01:43.130496 20924 heartbeater.cc:344] Connected to a master server at 127.20.32.61:42669
I20251214 21:01:43.130620 20924 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.130904 20924 heartbeater.cc:507] Master 127.20.32.61:42669 requested a full tablet report, sending...
I20251214 21:01:43.130496 20922 heartbeater.cc:507] Master 127.20.32.60:34609 requested a full tablet report, sending...
W20251214 21:01:43.132203 20930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:43.132426 20767 ts_manager.cc:194] Registered new tserver with Master: f688e7c1b98a4c9b9e33be624651c801 (127.20.32.1:38935)
W20251214 21:01:43.132494 20932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:43.132193 20704 ts_manager.cc:194] Registered new tserver with Master: f688e7c1b98a4c9b9e33be624651c801 (127.20.32.1:38935)
I20251214 21:01:43.132861 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:43.133116 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20251214 21:01:43.132193 20638 ts_manager.cc:194] Registered new tserver with Master: f688e7c1b98a4c9b9e33be624651c801 (127.20.32.1:38935)
W20251214 21:01:43.133164 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:43.133237 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746103133236 us; error 0 us; skew 500 ppm
I20251214 21:01:43.134336 20608 webserver.cc:492] Webserver started at http://127.20.32.2:37237/ using document root <none> and password file <none>
I20251214 21:01:43.134492 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:43.134545 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:43.134617 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:43.134971 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "6e5e29fc262849a6847e3ed482e33c43"
format_stamp: "Formatted at 2025-12-14 21:01:43 on dist-test-slave-bphs"
I20251214 21:01:43.136369 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:43.137923 20937 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.138199 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:43.138263 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "6e5e29fc262849a6847e3ed482e33c43"
format_stamp: "Formatted at 2025-12-14 21:01:43 on dist-test-slave-bphs"
I20251214 21:01:43.138335 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:43.159709 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:43.160171 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:43.160696 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:43.161182 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:43.161221 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.161252 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:43.161279 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.166996 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:39881
I20251214 21:01:43.167042 21000 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:39881 every 8 connection(s)
I20251214 21:01:43.168017 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:43.170259 21010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:43.171247 21007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:43.171763 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:43.173050 21002 heartbeater.cc:344] Connected to a master server at 127.20.32.62:38305
I20251214 21:01:43.173151 21002 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.173388 21002 heartbeater.cc:507] Master 127.20.32.62:38305 requested a full tablet report, sending...
I20251214 21:01:43.174226 21001 heartbeater.cc:344] Connected to a master server at 127.20.32.60:34609
W20251214 21:01:43.174235 21008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:43.174255 20638 ts_manager.cc:194] Registered new tserver with Master: 6e5e29fc262849a6847e3ed482e33c43 (127.20.32.2:39881)
I20251214 21:01:43.174363 21001 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.174640 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:43.174685 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:43.174719 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746103174719 us; error 0 us; skew 500 ppm
I20251214 21:01:43.174690 21001 heartbeater.cc:507] Master 127.20.32.60:34609 requested a full tablet report, sending...
I20251214 21:01:43.175428 20767 ts_manager.cc:194] Registered new tserver with Master: 6e5e29fc262849a6847e3ed482e33c43 (127.20.32.2:39881)
I20251214 21:01:43.175801 20608 webserver.cc:492] Webserver started at http://127.20.32.3:37639/ using document root <none> and password file <none>
I20251214 21:01:43.175962 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:43.176023 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:43.176097 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:43.176525 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "2b7f726b526648ed846b7bc7f7806197"
format_stamp: "Formatted at 2025-12-14 21:01:43 on dist-test-slave-bphs"
I20251214 21:01:43.178287 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20251214 21:01:43.179030 21003 heartbeater.cc:344] Connected to a master server at 127.20.32.61:42669
I20251214 21:01:43.179154 21003 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.179435 21016 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.179445 21003 heartbeater.cc:507] Master 127.20.32.61:42669 requested a full tablet report, sending...
I20251214 21:01:43.179847 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:43.179957 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "2b7f726b526648ed846b7bc7f7806197"
format_stamp: "Formatted at 2025-12-14 21:01:43 on dist-test-slave-bphs"
I20251214 21:01:43.180111 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:43.180228 20704 ts_manager.cc:194] Registered new tserver with Master: 6e5e29fc262849a6847e3ed482e33c43 (127.20.32.2:39881)
I20251214 21:01:43.187392 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:43.187808 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:43.188087 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:43.188568 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:43.188608 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.188648 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:43.188676 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:43.194465 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:37231
I20251214 21:01:43.194577 21079 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:37231 every 8 connection(s)
I20251214 21:01:43.200260 21081 heartbeater.cc:344] Connected to a master server at 127.20.32.62:38305
I20251214 21:01:43.200450 21081 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.200634 21080 heartbeater.cc:344] Connected to a master server at 127.20.32.60:34609
I20251214 21:01:43.200634 21082 heartbeater.cc:344] Connected to a master server at 127.20.32.61:42669
I20251214 21:01:43.200793 21080 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.200825 21082 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:43.201009 21080 heartbeater.cc:507] Master 127.20.32.60:34609 requested a full tablet report, sending...
I20251214 21:01:43.201014 21082 heartbeater.cc:507] Master 127.20.32.61:42669 requested a full tablet report, sending...
I20251214 21:01:43.200691 21081 heartbeater.cc:507] Master 127.20.32.62:38305 requested a full tablet report, sending...
I20251214 21:01:43.201752 20638 ts_manager.cc:194] Registered new tserver with Master: 2b7f726b526648ed846b7bc7f7806197 (127.20.32.3:37231)
I20251214 21:01:43.201752 20704 ts_manager.cc:194] Registered new tserver with Master: 2b7f726b526648ed846b7bc7f7806197 (127.20.32.3:37231)
I20251214 21:01:43.202212 20767 ts_manager.cc:194] Registered new tserver with Master: 2b7f726b526648ed846b7bc7f7806197 (127.20.32.3:37231)
I20251214 21:01:43.203266 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.008176052s
W20251214 21:01:43.228610 20627 tablet.cc:2378] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:01:43.262178 20812 raft_consensus.cc:493] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:43.262362 20812 raft_consensus.cc:515] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.263228 20812 leader_election.cc:290] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cca52670587547feb145d012ed004f78 (127.20.32.61:42669), 09ca5a700c544e2fa7681c17b209db73 (127.20.32.60:34609)
I20251214 21:01:43.263756 20780 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ca5a700c544e2fa7681c17b209db73" is_pre_election: true
I20251214 21:01:43.263762 20714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca52670587547feb145d012ed004f78" is_pre_election: true
I20251214 21:01:43.263947 20780 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad0df1ba2234c6ba8d21572a1e2ad0d in term 0.
I20251214 21:01:43.263964 20714 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad0df1ba2234c6ba8d21572a1e2ad0d in term 0.
I20251214 21:01:43.264331 20623 leader_election.cc:304] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ca5a700c544e2fa7681c17b209db73, dad0df1ba2234c6ba8d21572a1e2ad0d; no voters:
I20251214 21:01:43.264561 20812 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:43.264634 20812 raft_consensus.cc:493] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:43.264678 20812 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:43.265534 20812 raft_consensus.cc:515] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.265901 20812 leader_election.cc:290] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [CANDIDATE]: Term 1 election: Requested vote from peers cca52670587547feb145d012ed004f78 (127.20.32.61:42669), 09ca5a700c544e2fa7681c17b209db73 (127.20.32.60:34609)
I20251214 21:01:43.266204 20780 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ca5a700c544e2fa7681c17b209db73"
I20251214 21:01:43.266206 20714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca52670587547feb145d012ed004f78"
I20251214 21:01:43.266310 20780 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:43.266322 20714 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:43.267087 20780 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad0df1ba2234c6ba8d21572a1e2ad0d in term 1.
I20251214 21:01:43.267086 20714 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad0df1ba2234c6ba8d21572a1e2ad0d in term 1.
I20251214 21:01:43.267397 20623 leader_election.cc:304] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ca5a700c544e2fa7681c17b209db73, dad0df1ba2234c6ba8d21572a1e2ad0d; no voters:
I20251214 21:01:43.267575 20812 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:43.267791 20812 raft_consensus.cc:697] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 1 LEADER]: Becoming Leader. State: Replica: dad0df1ba2234c6ba8d21572a1e2ad0d, State: Running, Role: LEADER
I20251214 21:01:43.268038 20812 consensus_queue.cc:237] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } }
I20251214 21:01:43.269681 21088 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad0df1ba2234c6ba8d21572a1e2ad0d. Latest consensus state: current_term: 1 leader_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.269809 21088 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:43.270138 21090 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:01:43.271045 21090 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:01:43.275596 20714 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 1 FOLLOWER]: Refusing update from remote peer dad0df1ba2234c6ba8d21572a1e2ad0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:43.275596 20780 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 1 FOLLOWER]: Refusing update from remote peer dad0df1ba2234c6ba8d21572a1e2ad0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:43.276094 20812 consensus_queue.cc:1048] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:43.276237 21088 consensus_queue.cc:1048] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:43.277868 20813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad0df1ba2234c6ba8d21572a1e2ad0d. Latest consensus state: current_term: 1 leader_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.277987 20813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:43.277877 20838 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad0df1ba2234c6ba8d21572a1e2ad0d. Latest consensus state: current_term: 1 leader_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.278133 20838 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:43.279435 21092 mvcc.cc:204] Tried to move back new op lower bound from 7232496039010525184 to 7232496038988316672. Current Snapshot: MvccSnapshot[applied={T|T < 7232496039010525184}]
I20251214 21:01:43.279640 21088 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.279739 21088 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:43.279698 20812 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.279801 20812 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:43.279726 20838 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.279893 20838 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:43.279963 20813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad0df1ba2234c6ba8d21572a1e2ad0d" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 38305 } } peers { permanent_uuid: "cca52670587547feb145d012ed004f78" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 42669 } } peers { permanent_uuid: "09ca5a700c544e2fa7681c17b209db73" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34609 } } }
I20251214 21:01:43.280061 20813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:43.282069 21090 catalog_manager.cc:1357] Generated new cluster ID: 1667347dd9314a0095461e526623e571
I20251214 21:01:43.282124 21090 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:01:43.306209 21090 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:01:43.307296 21090 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:01:43.315557 21090 catalog_manager.cc:6027] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d: Generated new TSK 0
I20251214 21:01:43.316509 21090 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:01:44.078498 20835 catalog_manager.cc:1269] Loaded cluster ID: 1667347dd9314a0095461e526623e571
I20251214 21:01:44.078581 20835 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: loading cluster ID for follower catalog manager: success
I20251214 21:01:44.079789 20835 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: acquiring CA information for follower catalog manager: success
I20251214 21:01:44.080439 20835 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251214 21:01:44.098073 20849 catalog_manager.cc:1269] Loaded cluster ID: 1667347dd9314a0095461e526623e571
I20251214 21:01:44.098160 20849 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78: loading cluster ID for follower catalog manager: success
I20251214 21:01:44.099282 20849 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78: acquiring CA information for follower catalog manager: success
I20251214 21:01:44.099798 20849 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251214 21:01:44.135320 20638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60030
I20251214 21:01:44.176261 20638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60044
I20251214 21:01:44.203841 20638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60056
I20251214 21:01:45.074549 20833 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:01:45.136605 20923 heartbeater.cc:499] Master 127.20.32.62:38305 was elected leader, sending a full tablet report...
I20251214 21:01:45.177261 21002 heartbeater.cc:499] Master 127.20.32.62:38305 was elected leader, sending a full tablet report...
I20251214 21:01:45.204602 21081 heartbeater.cc:499] Master 127.20.32.62:38305 was elected leader, sending a full tablet report...
I20251214 21:01:45.457185 20608 test_util.cc:276] Using random seed: -849274341
I20251214 21:01:45.469918 20638 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60060:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251214 21:01:45.488081 21044 tablet_service.cc:1505] Processing CreateTablet for tablet 2736a1caa2b9435eaefa4ee9d65b6a83 (DEFAULT_TABLE table=test-workload [id=c85e0c62ee8f43efbcb225cd2edea588]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:01:45.488140 20965 tablet_service.cc:1505] Processing CreateTablet for tablet f0dbbd4e26c44988b8107165e68dda8b (DEFAULT_TABLE table=test-workload [id=c85e0c62ee8f43efbcb225cd2edea588]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:01:45.488449 20886 tablet_service.cc:1505] Processing CreateTablet for tablet 8a5bcfcd6cfa49fa912b088b7d718aaf (DEFAULT_TABLE table=test-workload [id=c85e0c62ee8f43efbcb225cd2edea588]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:01:45.488572 20965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0dbbd4e26c44988b8107165e68dda8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:45.488678 20886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5bcfcd6cfa49fa912b088b7d718aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:45.488576 21044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2736a1caa2b9435eaefa4ee9d65b6a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:45.490861 21128 tablet_bootstrap.cc:492] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197: Bootstrap starting.
I20251214 21:01:45.491065 20885 tablet_service.cc:1505] Processing CreateTablet for tablet fd8e38d7f40e4deeb41b4949d8782a19 (DEFAULT_TABLE table=test-workload [id=c85e0c62ee8f43efbcb225cd2edea588]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:01:45.491313 20885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd8e38d7f40e4deeb41b4949d8782a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:45.491415 21129 tablet_bootstrap.cc:492] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43: Bootstrap starting.
I20251214 21:01:45.491830 21128 tablet_bootstrap.cc:654] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:45.492233 21129 tablet_bootstrap.cc:654] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:45.491313 21130 tablet_bootstrap.cc:492] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801: Bootstrap starting.
I20251214 21:01:45.493115 21129 tablet_bootstrap.cc:492] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43: No bootstrap required, opened a new log
I20251214 21:01:45.493135 21128 tablet_bootstrap.cc:492] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197: No bootstrap required, opened a new log
I20251214 21:01:45.493201 21129 ts_tablet_manager.cc:1403] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:01:45.493327 21128 ts_tablet_manager.cc:1403] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:45.493608 21129 raft_consensus.cc:359] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5e29fc262849a6847e3ed482e33c43" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 39881 } }
I20251214 21:01:45.493660 21128 raft_consensus.cc:359] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7f726b526648ed846b7bc7f7806197" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 37231 } }
I20251214 21:01:45.493794 21128 raft_consensus.cc:385] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:45.493741 21130 tablet_bootstrap.cc:654] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:45.493825 21128 raft_consensus.cc:740] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b7f726b526648ed846b7bc7f7806197, State: Initialized, Role: FOLLOWER
I20251214 21:01:45.493918 21128 consensus_queue.cc:260] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7f726b526648ed846b7bc7f7806197" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 37231 } }
I20251214 21:01:45.493736 21129 raft_consensus.cc:385] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:45.493968 21128 raft_consensus.cc:399] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:45.493996 21128 raft_consensus.cc:493] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:45.493979 21129 raft_consensus.cc:740] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e5e29fc262849a6847e3ed482e33c43, State: Initialized, Role: FOLLOWER
I20251214 21:01:45.494024 21128 raft_consensus.cc:3060] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:45.494105 21129 consensus_queue.cc:260] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5e29fc262849a6847e3ed482e33c43" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 39881 } }
I20251214 21:01:45.494220 21129 raft_consensus.cc:399] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:45.494256 21129 raft_consensus.cc:493] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:45.494292 21129 raft_consensus.cc:3060] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:45.494792 21128 raft_consensus.cc:515] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7f726b526648ed846b7bc7f7806197" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 37231 } }
I20251214 21:01:45.494851 21130 tablet_bootstrap.cc:492] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801: No bootstrap required, opened a new log
I20251214 21:01:45.494920 21130 ts_tablet_manager.cc:1403] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20251214 21:01:45.495110 21129 raft_consensus.cc:515] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5e29fc262849a6847e3ed482e33c43" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 39881 } }
I20251214 21:01:45.495218 21129 leader_election.cc:304] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e5e29fc262849a6847e3ed482e33c43; no voters:
I20251214 21:01:45.495296 21130 raft_consensus.cc:359] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } }
I20251214 21:01:45.495380 21130 raft_consensus.cc:385] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:45.495393 21129 leader_election.cc:290] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:45.495416 21130 raft_consensus.cc:740] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f688e7c1b98a4c9b9e33be624651c801, State: Initialized, Role: FOLLOWER
I20251214 21:01:45.495517 21130 consensus_queue.cc:260] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } }
I20251214 21:01:45.495605 21130 raft_consensus.cc:399] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:45.495642 21130 raft_consensus.cc:493] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:45.495685 21130 raft_consensus.cc:3060] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:45.495703 21129 ts_tablet_manager.cc:1434] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20251214 21:01:45.496312 21130 raft_consensus.cc:515] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } }
I20251214 21:01:45.496412 21130 leader_election.cc:304] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f688e7c1b98a4c9b9e33be624651c801; no voters:
I20251214 21:01:45.496554 21130 leader_election.cc:290] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:45.496703 21136 raft_consensus.cc:2804] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:45.494943 21128 leader_election.cc:304] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b7f726b526648ed846b7bc7f7806197; no voters:
I20251214 21:01:45.496896 21136 raft_consensus.cc:697] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 1 LEADER]: Becoming Leader. State: Replica: f688e7c1b98a4c9b9e33be624651c801, State: Running, Role: LEADER
I20251214 21:01:45.496912 21128 leader_election.cc:290] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:45.497028 21136 consensus_queue.cc:237] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } }
I20251214 21:01:45.497186 21128 ts_tablet_manager.cc:1434] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:01:45.497459 21130 ts_tablet_manager.cc:1434] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251214 21:01:45.497619 21130 tablet_bootstrap.cc:492] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801: Bootstrap starting.
I20251214 21:01:45.498456 21130 tablet_bootstrap.cc:654] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:45.499890 20637 catalog_manager.cc:5654] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 reported cstate change: term changed from 0 to 1, leader changed from <none> to f688e7c1b98a4c9b9e33be624651c801 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "f688e7c1b98a4c9b9e33be624651c801" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:45.500474 21130 tablet_bootstrap.cc:492] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801: No bootstrap required, opened a new log
I20251214 21:01:45.500563 21130 ts_tablet_manager.cc:1403] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:01:45.495541 21134 raft_consensus.cc:2804] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:45.500878 21134 raft_consensus.cc:697] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 1 LEADER]: Becoming Leader. State: Replica: 6e5e29fc262849a6847e3ed482e33c43, State: Running, Role: LEADER
I20251214 21:01:45.500918 21130 raft_consensus.cc:359] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } }
I20251214 21:01:45.500982 21130 raft_consensus.cc:385] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:45.500993 21134 consensus_queue.cc:237] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5e29fc262849a6847e3ed482e33c43" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 39881 } }
I20251214 21:01:45.501010 21130 raft_consensus.cc:740] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f688e7c1b98a4c9b9e33be624651c801, State: Initialized, Role: FOLLOWER
I20251214 21:01:45.501184 21130 consensus_queue.cc:260] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } }
I20251214 21:01:45.501257 21130 raft_consensus.cc:399] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:45.501286 21130 raft_consensus.cc:493] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:45.501319 21130 raft_consensus.cc:3060] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:45.502286 21130 raft_consensus.cc:515] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } }
I20251214 21:01:45.502404 21130 leader_election.cc:304] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f688e7c1b98a4c9b9e33be624651c801; no voters:
I20251214 21:01:45.502485 21130 leader_election.cc:290] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:45.502599 21137 raft_consensus.cc:2804] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:45.502671 21137 raft_consensus.cc:697] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 1 LEADER]: Becoming Leader. State: Replica: f688e7c1b98a4c9b9e33be624651c801, State: Running, Role: LEADER
I20251214 21:01:45.502765 21137 consensus_queue.cc:237] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } }
I20251214 21:01:45.503611 21130 ts_tablet_manager.cc:1434] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:45.503620 20638 catalog_manager.cc:5654] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e5e29fc262849a6847e3ed482e33c43 (127.20.32.2). New cstate: current_term: 1 leader_uuid: "6e5e29fc262849a6847e3ed482e33c43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5e29fc262849a6847e3ed482e33c43" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 39881 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:45.506134 20637 catalog_manager.cc:5654] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 reported cstate change: term changed from 0 to 1, leader changed from <none> to f688e7c1b98a4c9b9e33be624651c801 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "f688e7c1b98a4c9b9e33be624651c801" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f688e7c1b98a4c9b9e33be624651c801" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38935 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:45.506325 21138 raft_consensus.cc:2804] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:45.506536 21138 raft_consensus.cc:697] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 1 LEADER]: Becoming Leader. State: Replica: 2b7f726b526648ed846b7bc7f7806197, State: Running, Role: LEADER
I20251214 21:01:45.506650 21138 consensus_queue.cc:237] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7f726b526648ed846b7bc7f7806197" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 37231 } }
I20251214 21:01:45.508471 20636 catalog_manager.cc:5654] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b7f726b526648ed846b7bc7f7806197 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "2b7f726b526648ed846b7bc7f7806197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b7f726b526648ed846b7bc7f7806197" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 37231 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:45.519140 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:01:45.523736 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:45.524101 20608 tablet_replica.cc:333] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801: stopping tablet replica
I20251214 21:01:45.524320 20608 raft_consensus.cc:2243] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:45.524457 20608 raft_consensus.cc:2272] T fd8e38d7f40e4deeb41b4949d8782a19 P f688e7c1b98a4c9b9e33be624651c801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:45.525576 20608 tablet_replica.cc:333] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801: stopping tablet replica
I20251214 21:01:45.525660 20608 raft_consensus.cc:2243] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:45.525771 20608 pending_rounds.cc:70] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801: Trying to abort 1 pending ops.
I20251214 21:01:45.525820 20608 pending_rounds.cc:77] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496048116277248 op_type: NO_OP noop_request { }
I20251214 21:01:45.525894 20608 raft_consensus.cc:2889] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:01:45.525938 20608 raft_consensus.cc:2272] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251214 21:01:45.534103 21141 consensus_queue.cc:1175] T 8a5bcfcd6cfa49fa912b088b7d718aaf P f688e7c1b98a4c9b9e33be624651c801 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f688e7c1b98a4c9b9e33be624651c801" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251214 21:01:45.548591 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:01:45.552927 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:01:45.556684 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:45.562529 20608 tablet_replica.cc:333] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43: stopping tablet replica
I20251214 21:01:45.562696 20608 raft_consensus.cc:2243] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:45.562848 20608 raft_consensus.cc:2272] T f0dbbd4e26c44988b8107165e68dda8b P 6e5e29fc262849a6847e3ed482e33c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:45.575753 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:01:45.577569 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:01:45.581202 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:45.581475 20608 tablet_replica.cc:333] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197: stopping tablet replica
I20251214 21:01:45.581604 20608 raft_consensus.cc:2243] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:45.581748 20608 raft_consensus.cc:2272] T 2736a1caa2b9435eaefa4ee9d65b6a83 P 2b7f726b526648ed846b7bc7f7806197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:45.594767 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:01:45.597015 20608 master.cc:561] Master@127.20.32.62:38305 shutting down...
I20251214 21:01:45.600411 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:45.600725 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:45.600826 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P dad0df1ba2234c6ba8d21572a1e2ad0d: stopping tablet replica
I20251214 21:01:45.614180 20608 master.cc:583] Master@127.20.32.62:38305 shutdown complete.
I20251214 21:01:45.617286 20608 master.cc:561] Master@127.20.32.61:42669 shutting down...
I20251214 21:01:45.620134 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:45.620321 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:45.620386 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P cca52670587547feb145d012ed004f78: stopping tablet replica
I20251214 21:01:45.633692 20608 master.cc:583] Master@127.20.32.61:42669 shutdown complete.
I20251214 21:01:45.636276 20608 master.cc:561] Master@127.20.32.60:34609 shutting down...
I20251214 21:01:45.639724 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:45.639910 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:45.639981 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 09ca5a700c544e2fa7681c17b209db73: stopping tablet replica
I20251214 21:01:45.652930 20608 master.cc:583] Master@127.20.32.60:34609 shutdown complete.
[ OK ] AutoRebalancerTest.OnlyLeaderDoesAutoRebalancing (2735 ms)
[ RUN ] AutoRebalancerTest.AutoRebalancingTurnOffAndOn
I20251214 21:01:45.660123 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:34041
I20251214 21:01:45.660455 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:45.662127 21154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:45.662241 21151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:45.662243 21152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:45.662366 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:45.662544 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:45.662585 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:45.662603 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746105662603 us; error 0 us; skew 500 ppm
I20251214 21:01:45.663411 20608 webserver.cc:492] Webserver started at http://127.20.32.62:38995/ using document root <none> and password file <none>
I20251214 21:01:45.663555 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:45.663609 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:45.663698 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:45.664062 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "71202ad58321488d91d3ea6cf44cf525"
format_stamp: "Formatted at 2025-12-14 21:01:45 on dist-test-slave-bphs"
I20251214 21:01:45.665406 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:45.666371 21159 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.666612 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:45.666673 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "71202ad58321488d91d3ea6cf44cf525"
format_stamp: "Formatted at 2025-12-14 21:01:45 on dist-test-slave-bphs"
I20251214 21:01:45.666750 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:45.675073 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:45.675446 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:45.679419 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:34041
I20251214 21:01:45.681914 21211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:34041 every 8 connection(s)
I20251214 21:01:45.682329 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:45.684085 21212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525: Bootstrap starting.
I20251214 21:01:45.684805 21212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:45.685912 21212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525: No bootstrap required, opened a new log
I20251214 21:01:45.686254 21212 raft_consensus.cc:359] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71202ad58321488d91d3ea6cf44cf525" member_type: VOTER }
I20251214 21:01:45.686332 21212 raft_consensus.cc:385] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:45.686358 21212 raft_consensus.cc:740] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71202ad58321488d91d3ea6cf44cf525, State: Initialized, Role: FOLLOWER
I20251214 21:01:45.686445 21212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71202ad58321488d91d3ea6cf44cf525" member_type: VOTER }
I20251214 21:01:45.686504 21212 raft_consensus.cc:399] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:45.686530 21212 raft_consensus.cc:493] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:45.686561 21212 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:45.687155 21212 raft_consensus.cc:515] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71202ad58321488d91d3ea6cf44cf525" member_type: VOTER }
I20251214 21:01:45.687258 21212 leader_election.cc:304] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71202ad58321488d91d3ea6cf44cf525; no voters:
I20251214 21:01:45.687388 21212 leader_election.cc:290] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:45.687484 21215 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:45.687681 21215 raft_consensus.cc:697] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 1 LEADER]: Becoming Leader. State: Replica: 71202ad58321488d91d3ea6cf44cf525, State: Running, Role: LEADER
I20251214 21:01:45.687780 21212 sys_catalog.cc:565] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:01:45.687803 21215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71202ad58321488d91d3ea6cf44cf525" member_type: VOTER }
I20251214 21:01:45.688182 21216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71202ad58321488d91d3ea6cf44cf525" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71202ad58321488d91d3ea6cf44cf525" member_type: VOTER } }
I20251214 21:01:45.688213 21217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71202ad58321488d91d3ea6cf44cf525. Latest consensus state: current_term: 1 leader_uuid: "71202ad58321488d91d3ea6cf44cf525" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71202ad58321488d91d3ea6cf44cf525" member_type: VOTER } }
I20251214 21:01:45.688278 21216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:45.688285 21217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:45.688527 21220 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:01:45.689267 21220 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:01:45.689574 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:01:45.691071 21220 catalog_manager.cc:1357] Generated new cluster ID: 23112ba0adc44cf1b9f4e891945bc7e4
I20251214 21:01:45.691120 21220 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:01:45.716091 21220 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:01:45.716662 21220 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:01:45.723867 21220 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525: Generated new TSK 0
I20251214 21:01:45.724040 21220 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:01:45.754343 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:45.756171 21236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:45.756246 21233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:45.756421 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:45.756294 21234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:45.756681 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:45.756723 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:45.756737 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746105756737 us; error 0 us; skew 500 ppm
I20251214 21:01:45.757571 20608 webserver.cc:492] Webserver started at http://127.20.32.1:45127/ using document root <none> and password file <none>
I20251214 21:01:45.757741 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:45.757804 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:45.757881 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:45.758273 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "146bd1c0819043ffa1d129fa48b23f22"
format_stamp: "Formatted at 2025-12-14 21:01:45 on dist-test-slave-bphs"
I20251214 21:01:45.759671 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:45.760578 21241 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.760834 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:45.760901 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "146bd1c0819043ffa1d129fa48b23f22"
format_stamp: "Formatted at 2025-12-14 21:01:45 on dist-test-slave-bphs"
I20251214 21:01:45.760969 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:45.779589 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:45.779994 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:45.780270 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:45.780731 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:45.780772 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.780814 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:45.780843 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.784714 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:45243
I20251214 21:01:45.784754 21304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:45243 every 8 connection(s)
I20251214 21:01:45.785455 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:45.787206 21309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:45.787214 21310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:45.787312 21312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:45.787484 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:45.788322 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:45.788378 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:45.788401 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746105788400 us; error 0 us; skew 500 ppm
I20251214 21:01:45.789165 20608 webserver.cc:492] Webserver started at http://127.20.32.2:39581/ using document root <none> and password file <none>
I20251214 21:01:45.789309 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:45.789358 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:45.789445 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:45.789510 21305 heartbeater.cc:344] Connected to a master server at 127.20.32.62:34041
I20251214 21:01:45.789602 21305 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:45.789842 21305 heartbeater.cc:507] Master 127.20.32.62:34041 requested a full tablet report, sending...
I20251214 21:01:45.789882 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "6dfd72c36cfa496491560250746c211c"
format_stamp: "Formatted at 2025-12-14 21:01:45 on dist-test-slave-bphs"
I20251214 21:01:45.790479 21176 ts_manager.cc:194] Registered new tserver with Master: 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243)
I20251214 21:01:45.791265 21176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50960
I20251214 21:01:45.791391 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:45.792503 21317 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.792778 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:45.792850 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "6dfd72c36cfa496491560250746c211c"
format_stamp: "Formatted at 2025-12-14 21:01:45 on dist-test-slave-bphs"
I20251214 21:01:45.792919 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:45.802096 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:45.802515 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:45.802788 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:45.803228 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:45.803267 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.803308 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:45.803336 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.808054 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:38255
I20251214 21:01:45.808274 21380 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:38255 every 8 connection(s)
I20251214 21:01:45.808917 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:45.810959 21385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:45.811038 21384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:45.811213 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:45.811326 21387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:45.811550 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:45.811590 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:45.811614 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746105811612 us; error 0 us; skew 500 ppm
I20251214 21:01:45.812477 20608 webserver.cc:492] Webserver started at http://127.20.32.3:44161/ using document root <none> and password file <none>
I20251214 21:01:45.812635 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:45.812687 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:45.812758 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:45.812925 21381 heartbeater.cc:344] Connected to a master server at 127.20.32.62:34041
I20251214 21:01:45.813019 21381 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:45.813167 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "10119fcbe5d5441da837901380471101"
format_stamp: "Formatted at 2025-12-14 21:01:45 on dist-test-slave-bphs"
I20251214 21:01:45.813230 21381 heartbeater.cc:507] Master 127.20.32.62:34041 requested a full tablet report, sending...
I20251214 21:01:45.813828 21176 ts_manager.cc:194] Registered new tserver with Master: 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255)
I20251214 21:01:45.814309 21176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50964
I20251214 21:01:45.814667 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:45.815526 21392 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.815760 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:45.815824 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "10119fcbe5d5441da837901380471101"
format_stamp: "Formatted at 2025-12-14 21:01:45 on dist-test-slave-bphs"
I20251214 21:01:45.815888 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:45.827232 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:45.827683 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:45.827978 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:45.828414 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:45.828469 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.828518 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:45.828545 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:45.832948 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:39321
I20251214 21:01:45.833006 21455 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:39321 every 8 connection(s)
I20251214 21:01:45.837399 21456 heartbeater.cc:344] Connected to a master server at 127.20.32.62:34041
I20251214 21:01:45.837502 21456 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:45.837764 21456 heartbeater.cc:507] Master 127.20.32.62:34041 requested a full tablet report, sending...
I20251214 21:01:45.838367 21176 ts_manager.cc:194] Registered new tserver with Master: 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:45.838932 21176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50980
I20251214 21:01:45.839015 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005666335s
I20251214 21:01:46.792254 21305 heartbeater.cc:499] Master 127.20.32.62:34041 was elected leader, sending a full tablet report...
I20251214 21:01:46.815214 21381 heartbeater.cc:499] Master 127.20.32.62:34041 was elected leader, sending a full tablet report...
I20251214 21:01:46.839990 21456 heartbeater.cc:499] Master 127.20.32.62:34041 was elected leader, sending a full tablet report...
I20251214 21:01:46.865537 20608 test_util.cc:276] Using random seed: -847865987
I20251214 21:01:46.874009 21176 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50992:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\017\004\001\000\376\377\377\037\004\001\000\375\377\377/\004\001\000\374\377\377?\004\001\000\373\377\377O\004\001\000\372\377\377_\004\001\000\371\377\377o""\004\001\000\377\377\377\017\004\001\000\376\377\377\037\004\001\000\375\377\377/\004\001\000\374\377\377?\004\001\000\373\377\377O\004\001\000\372\377\377_\004\001\000\371\377\377o"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:01:46.874625 21176 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:01:46.887590 21269 tablet_service.cc:1505] Processing CreateTablet for tablet 89021295f5b544e2b5f7c85a79c326fb (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION VALUES < 268435455
I20251214 21:01:46.887959 21269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89021295f5b544e2b5f7c85a79c326fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.887909 21264 tablet_service.cc:1505] Processing CreateTablet for tablet 272141ec18f0403ebfbe8acc05bca2f0 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1342177275 <= VALUES < 1610612730
I20251214 21:01:46.888186 21264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272141ec18f0403ebfbe8acc05bca2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.888456 21263 tablet_service.cc:1505] Processing CreateTablet for tablet fd60f0da6e6041ac96ec7093a702e92e (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1879048185
I20251214 21:01:46.888759 21263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd60f0da6e6041ac96ec7093a702e92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.888790 21265 tablet_service.cc:1505] Processing CreateTablet for tablet e724a1cda1d640a88514da8a6e7f80cd (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1342177275
I20251214 21:01:46.888816 21341 tablet_service.cc:1505] Processing CreateTablet for tablet 272141ec18f0403ebfbe8acc05bca2f0 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1342177275 <= VALUES < 1610612730
I20251214 21:01:46.889005 21265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e724a1cda1d640a88514da8a6e7f80cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.889063 21341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272141ec18f0403ebfbe8acc05bca2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.889097 21344 tablet_service.cc:1505] Processing CreateTablet for tablet 89021295f5b544e2b5f7c85a79c326fb (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION VALUES < 268435455
I20251214 21:01:46.889307 21344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89021295f5b544e2b5f7c85a79c326fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.889351 21345 tablet_service.cc:1505] Processing CreateTablet for tablet f794bb9a3570451caa69144941b3f449 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 268435455 <= VALUES < 536870910
I20251214 21:01:46.889595 21345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f794bb9a3570451caa69144941b3f449. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.891394 21342 tablet_service.cc:1505] Processing CreateTablet for tablet d94f27f985124d7a883c4cae76287d48 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 805306365
I20251214 21:01:46.891515 21268 tablet_service.cc:1505] Processing CreateTablet for tablet f794bb9a3570451caa69144941b3f449 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 268435455 <= VALUES < 536870910
I20251214 21:01:46.891546 21343 tablet_service.cc:1505] Processing CreateTablet for tablet e724a1cda1d640a88514da8a6e7f80cd (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1342177275
I20251214 21:01:46.891618 21342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94f27f985124d7a883c4cae76287d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.891736 21268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f794bb9a3570451caa69144941b3f449. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.888705 21339 tablet_service.cc:1505] Processing CreateTablet for tablet 090f9cf51a6442fdacc2f5d29baea127 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 805306365 <= VALUES < 1073741820
I20251214 21:01:46.893074 21266 tablet_service.cc:1505] Processing CreateTablet for tablet 090f9cf51a6442fdacc2f5d29baea127 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 805306365 <= VALUES < 1073741820
I20251214 21:01:46.893306 21266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090f9cf51a6442fdacc2f5d29baea127. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.893587 21264 tablet_service.cc:1505] Processing CreateTablet for tablet 87237e19c05b4ad2809dfb7bf10dba6b (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1879048185 <= VALUES
I20251214 21:01:46.893837 21264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87237e19c05b4ad2809dfb7bf10dba6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.893930 21267 tablet_service.cc:1505] Processing CreateTablet for tablet d94f27f985124d7a883c4cae76287d48 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 805306365
I20251214 21:01:46.894150 21267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94f27f985124d7a883c4cae76287d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.891741 21343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e724a1cda1d640a88514da8a6e7f80cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.896478 21345 tablet_service.cc:1505] Processing CreateTablet for tablet fd60f0da6e6041ac96ec7093a702e92e (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1879048185
I20251214 21:01:46.896698 21345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd60f0da6e6041ac96ec7093a702e92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.897020 21339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090f9cf51a6442fdacc2f5d29baea127. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.897747 21477 tablet_bootstrap.cc:492] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c: Bootstrap starting.
I20251214 21:01:46.897753 21342 tablet_service.cc:1505] Processing CreateTablet for tablet 87237e19c05b4ad2809dfb7bf10dba6b (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1879048185 <= VALUES
I20251214 21:01:46.898044 21342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87237e19c05b4ad2809dfb7bf10dba6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.898782 21477 tablet_bootstrap.cc:654] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.898823 21476 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22: Bootstrap starting.
I20251214 21:01:46.899763 21476 tablet_bootstrap.cc:654] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.900826 21477 tablet_bootstrap.cc:492] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c: No bootstrap required, opened a new log
I20251214 21:01:46.900839 21476 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22: No bootstrap required, opened a new log
I20251214 21:01:46.901011 21476 ts_tablet_manager.cc:1403] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:01:46.901032 21477 ts_tablet_manager.cc:1403] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:46.901510 21476 raft_consensus.cc:359] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.901618 21476 raft_consensus.cc:385] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.901649 21476 raft_consensus.cc:740] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.901785 21476 consensus_queue.cc:260] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.901966 21419 tablet_service.cc:1505] Processing CreateTablet for tablet f794bb9a3570451caa69144941b3f449 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 268435455 <= VALUES < 536870910
I20251214 21:01:46.902129 21476 ts_tablet_manager.cc:1434] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.902081 21417 tablet_service.cc:1505] Processing CreateTablet for tablet 090f9cf51a6442fdacc2f5d29baea127 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 805306365 <= VALUES < 1073741820
I20251214 21:01:46.902225 21419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f794bb9a3570451caa69144941b3f449. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.902312 21476 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22: Bootstrap starting.
I20251214 21:01:46.902278 21414 tablet_service.cc:1505] Processing CreateTablet for tablet fd60f0da6e6041ac96ec7093a702e92e (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1879048185
I20251214 21:01:46.902483 21417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090f9cf51a6442fdacc2f5d29baea127. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.902658 21413 tablet_service.cc:1505] Processing CreateTablet for tablet 87237e19c05b4ad2809dfb7bf10dba6b (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1879048185 <= VALUES
I20251214 21:01:46.902869 21413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87237e19c05b4ad2809dfb7bf10dba6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.903239 21476 tablet_bootstrap.cc:654] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.904516 21418 tablet_service.cc:1505] Processing CreateTablet for tablet d94f27f985124d7a883c4cae76287d48 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 805306365
I20251214 21:01:46.904693 21414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd60f0da6e6041ac96ec7093a702e92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.904851 21418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94f27f985124d7a883c4cae76287d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.904922 21416 tablet_service.cc:1505] Processing CreateTablet for tablet e724a1cda1d640a88514da8a6e7f80cd (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1342177275
I20251214 21:01:46.905175 21416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e724a1cda1d640a88514da8a6e7f80cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.906204 21482 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101: Bootstrap starting.
I20251214 21:01:46.907044 21415 tablet_service.cc:1505] Processing CreateTablet for tablet 272141ec18f0403ebfbe8acc05bca2f0 (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION 1342177275 <= VALUES < 1610612730
I20251214 21:01:46.907158 21482 tablet_bootstrap.cc:654] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.907255 21415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272141ec18f0403ebfbe8acc05bca2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.908140 21476 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22: No bootstrap required, opened a new log
I20251214 21:01:46.908088 21420 tablet_service.cc:1505] Processing CreateTablet for tablet 89021295f5b544e2b5f7c85a79c326fb (DEFAULT_TABLE table=test-workload [id=65e0c7cf66fd44c88495af070480cceb]), partition=RANGE (key) PARTITION VALUES < 268435455
I20251214 21:01:46.908176 21482 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101: No bootstrap required, opened a new log
I20251214 21:01:46.908232 21476 ts_tablet_manager.cc:1403] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251214 21:01:46.908250 21482 ts_tablet_manager.cc:1403] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:01:46.908324 21420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89021295f5b544e2b5f7c85a79c326fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:46.908700 21476 raft_consensus.cc:359] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.908831 21476 raft_consensus.cc:385] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.908874 21476 raft_consensus.cc:740] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.908986 21476 consensus_queue.cc:260] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.909328 21476 ts_tablet_manager.cc:1434] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.909495 21476 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22: Bootstrap starting.
I20251214 21:01:46.909855 21482 raft_consensus.cc:359] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.909960 21482 raft_consensus.cc:385] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.909991 21482 raft_consensus.cc:740] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10119fcbe5d5441da837901380471101, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.910214 21482 consensus_queue.cc:260] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.910403 21476 tablet_bootstrap.cc:654] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.910540 21482 ts_tablet_manager.cc:1434] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:01:46.910748 21482 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101: Bootstrap starting.
I20251214 21:01:46.901525 21477 raft_consensus.cc:359] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.911124 21477 raft_consensus.cc:385] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.911170 21477 raft_consensus.cc:740] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.911300 21477 consensus_queue.cc:260] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.912379 21476 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22: No bootstrap required, opened a new log
I20251214 21:01:46.911628 21477 ts_tablet_manager.cc:1434] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20251214 21:01:46.911652 21482 tablet_bootstrap.cc:654] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.912485 21476 ts_tablet_manager.cc:1403] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:46.912564 21477 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c: Bootstrap starting.
I20251214 21:01:46.912887 21476 raft_consensus.cc:359] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.912979 21476 raft_consensus.cc:385] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.913008 21476 raft_consensus.cc:740] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.913115 21476 consensus_queue.cc:260] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.913341 21476 ts_tablet_manager.cc:1434] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:46.913430 21477 tablet_bootstrap.cc:654] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.913486 21482 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101: No bootstrap required, opened a new log
I20251214 21:01:46.913580 21482 ts_tablet_manager.cc:1403] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:46.914024 21482 raft_consensus.cc:359] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.914129 21482 raft_consensus.cc:385] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.914168 21482 raft_consensus.cc:740] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10119fcbe5d5441da837901380471101, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.913496 21476 tablet_bootstrap.cc:492] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22: Bootstrap starting.
I20251214 21:01:46.914276 21482 consensus_queue.cc:260] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.914513 21482 ts_tablet_manager.cc:1434] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:46.914685 21482 tablet_bootstrap.cc:492] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101: Bootstrap starting.
I20251214 21:01:46.915056 21476 tablet_bootstrap.cc:654] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.915601 21482 tablet_bootstrap.cc:654] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.915781 21477 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c: No bootstrap required, opened a new log
I20251214 21:01:46.915867 21477 ts_tablet_manager.cc:1403] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251214 21:01:46.916302 21477 raft_consensus.cc:359] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.916384 21477 raft_consensus.cc:385] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.916416 21477 raft_consensus.cc:740] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.916522 21477 consensus_queue.cc:260] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.916785 21477 ts_tablet_manager.cc:1434] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:46.917007 21477 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c: Bootstrap starting.
I20251214 21:01:46.917160 21476 tablet_bootstrap.cc:492] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22: No bootstrap required, opened a new log
I20251214 21:01:46.917233 21476 ts_tablet_manager.cc:1403] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251214 21:01:46.917636 21476 raft_consensus.cc:359] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.917762 21476 raft_consensus.cc:385] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.917807 21476 raft_consensus.cc:740] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.917950 21477 tablet_bootstrap.cc:654] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.917919 21476 consensus_queue.cc:260] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.918232 21476 ts_tablet_manager.cc:1434] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.918388 21476 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22: Bootstrap starting.
I20251214 21:01:46.918978 21482 tablet_bootstrap.cc:492] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101: No bootstrap required, opened a new log
I20251214 21:01:46.919052 21482 ts_tablet_manager.cc:1403] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20251214 21:01:46.919265 21476 tablet_bootstrap.cc:654] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.919411 21482 raft_consensus.cc:359] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.920070 21482 raft_consensus.cc:385] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.920107 21482 raft_consensus.cc:740] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10119fcbe5d5441da837901380471101, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.920204 21476 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22: No bootstrap required, opened a new log
I20251214 21:01:46.920204 21477 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c: No bootstrap required, opened a new log
I20251214 21:01:46.920240 21482 consensus_queue.cc:260] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.920327 21476 ts_tablet_manager.cc:1403] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:01:46.920327 21477 ts_tablet_manager.cc:1403] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:46.920738 21476 raft_consensus.cc:359] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.920751 21477 raft_consensus.cc:359] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.920857 21477 raft_consensus.cc:385] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.920861 21476 raft_consensus.cc:385] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.920898 21477 raft_consensus.cc:740] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.920918 21476 raft_consensus.cc:740] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.921000 21477 consensus_queue.cc:260] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.921005 21476 consensus_queue.cc:260] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.921255 21477 ts_tablet_manager.cc:1434] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:46.921255 21476 ts_tablet_manager.cc:1434] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.921425 21477 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c: Bootstrap starting.
I20251214 21:01:46.921447 21476 tablet_bootstrap.cc:492] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22: Bootstrap starting.
I20251214 21:01:46.920809 21482 ts_tablet_manager.cc:1434] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251214 21:01:46.922014 21482 tablet_bootstrap.cc:492] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101: Bootstrap starting.
I20251214 21:01:46.922350 21476 tablet_bootstrap.cc:654] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.922350 21477 tablet_bootstrap.cc:654] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.923157 21484 raft_consensus.cc:493] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:46.923238 21484 raft_consensus.cc:515] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.923472 21476 tablet_bootstrap.cc:492] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22: No bootstrap required, opened a new log
I20251214 21:01:46.923558 21476 ts_tablet_manager.cc:1403] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:01:46.923754 21485 raft_consensus.cc:493] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:46.923811 21484 leader_election.cc:290] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:46.923836 21485 raft_consensus.cc:515] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.923941 21476 raft_consensus.cc:359] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.923996 21482 tablet_bootstrap.cc:654] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.924041 21476 raft_consensus.cc:385] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.924069 21476 raft_consensus.cc:740] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.924165 21476 consensus_queue.cc:260] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.924222 21485 leader_election.cc:290] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255)
I20251214 21:01:46.924396 21476 ts_tablet_manager.cc:1434] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:46.924571 21476 tablet_bootstrap.cc:492] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22: Bootstrap starting.
I20251214 21:01:46.925004 21477 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c: No bootstrap required, opened a new log
I20251214 21:01:46.925084 21477 ts_tablet_manager.cc:1403] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:01:46.925396 21476 tablet_bootstrap.cc:654] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.925457 21477 raft_consensus.cc:359] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.925546 21477 raft_consensus.cc:385] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.925587 21477 raft_consensus.cc:740] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.925694 21477 consensus_queue.cc:260] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.925957 21477 ts_tablet_manager.cc:1434] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.926117 21477 tablet_bootstrap.cc:492] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c: Bootstrap starting.
I20251214 21:01:46.926941 21477 tablet_bootstrap.cc:654] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.928119 21477 tablet_bootstrap.cc:492] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c: No bootstrap required, opened a new log
I20251214 21:01:46.928189 21477 ts_tablet_manager.cc:1403] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:01:46.928572 21477 raft_consensus.cc:359] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.928668 21477 raft_consensus.cc:385] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.928699 21477 raft_consensus.cc:740] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.928803 21477 consensus_queue.cc:260] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.929039 21477 ts_tablet_manager.cc:1434] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.929189 21477 tablet_bootstrap.cc:492] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c: Bootstrap starting.
I20251214 21:01:46.929647 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f794bb9a3570451caa69144941b3f449" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22" is_pre_election: true
I20251214 21:01:46.929777 21279 raft_consensus.cc:2468] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 0.
I20251214 21:01:46.930033 21477 tablet_bootstrap.cc:654] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.930063 21396 leader_election.cc:304] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 146bd1c0819043ffa1d129fa48b23f22; no voters:
I20251214 21:01:46.930225 21485 raft_consensus.cc:2804] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:46.930272 21485 raft_consensus.cc:493] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:46.930310 21485 raft_consensus.cc:3060] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.930508 21476 tablet_bootstrap.cc:492] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22: No bootstrap required, opened a new log
I20251214 21:01:46.930599 21476 ts_tablet_manager.cc:1403] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20251214 21:01:46.930823 21482 tablet_bootstrap.cc:492] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101: No bootstrap required, opened a new log
I20251214 21:01:46.930905 21482 ts_tablet_manager.cc:1403] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20251214 21:01:46.930996 21476 raft_consensus.cc:359] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.931087 21476 raft_consensus.cc:385] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.931123 21476 raft_consensus.cc:740] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.931241 21476 consensus_queue.cc:260] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.931311 21485 raft_consensus.cc:515] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.931310 21482 raft_consensus.cc:359] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.931424 21482 raft_consensus.cc:385] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.931458 21482 raft_consensus.cc:740] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10119fcbe5d5441da837901380471101, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.931506 21476 ts_tablet_manager.cc:1434] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:46.931558 21482 consensus_queue.cc:260] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.931660 21476 tablet_bootstrap.cc:492] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22: Bootstrap starting.
I20251214 21:01:46.931878 21482 ts_tablet_manager.cc:1434] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:46.932035 21482 tablet_bootstrap.cc:492] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101: Bootstrap starting.
I20251214 21:01:46.932533 21476 tablet_bootstrap.cc:654] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.932868 21482 tablet_bootstrap.cc:654] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.933521 21476 tablet_bootstrap.cc:492] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22: No bootstrap required, opened a new log
I20251214 21:01:46.933655 21476 ts_tablet_manager.cc:1403] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251214 21:01:46.934515 21355 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f794bb9a3570451caa69144941b3f449" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c" is_pre_election: true
I20251214 21:01:46.934653 21355 raft_consensus.cc:2468] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 0.
I20251214 21:01:46.931658 21485 leader_election.cc:290] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 election: Requested vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255)
I20251214 21:01:46.934794 21476 raft_consensus.cc:359] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.934887 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f794bb9a3570451caa69144941b3f449" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c"
I20251214 21:01:46.935081 21354 raft_consensus.cc:3060] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.936049 21354 raft_consensus.cc:2468] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 1.
I20251214 21:01:46.936436 21395 leader_election.cc:304] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:46.936645 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f794bb9a3570451caa69144941b3f449" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22"
I20251214 21:01:46.936741 21279 raft_consensus.cc:3060] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.936786 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e724a1cda1d640a88514da8a6e7f80cd" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101" is_pre_election: true
I20251214 21:01:46.936887 21482 tablet_bootstrap.cc:492] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101: No bootstrap required, opened a new log
I20251214 21:01:46.936972 21482 ts_tablet_manager.cc:1403] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
W20251214 21:01:46.937268 21245 leader_election.cc:343] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10119fcbe5d5441da837901380471101 (127.20.32.3:39321): Illegal state: must be running to vote when last-logged opid is not known
I20251214 21:01:46.937350 21482 raft_consensus.cc:359] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.937414 21485 raft_consensus.cc:2804] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:46.937448 21482 raft_consensus.cc:385] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.937476 21485 raft_consensus.cc:697] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 1 LEADER]: Becoming Leader. State: Replica: 10119fcbe5d5441da837901380471101, State: Running, Role: LEADER
I20251214 21:01:46.937623 21279 raft_consensus.cc:2468] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 1.
I20251214 21:01:46.937484 21482 raft_consensus.cc:740] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10119fcbe5d5441da837901380471101, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.934995 21476 raft_consensus.cc:385] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.937819 21482 consensus_queue.cc:260] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.937880 21476 raft_consensus.cc:740] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.938017 21476 consensus_queue.cc:260] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.938091 21477 tablet_bootstrap.cc:492] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c: No bootstrap required, opened a new log
I20251214 21:01:46.938160 21477 ts_tablet_manager.cc:1403] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251214 21:01:46.938060 21482 ts_tablet_manager.cc:1434] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.938284 21476 ts_tablet_manager.cc:1434] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251214 21:01:46.938383 21482 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101: Bootstrap starting.
I20251214 21:01:46.938544 21477 raft_consensus.cc:359] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.938611 21477 raft_consensus.cc:385] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.938628 21477 raft_consensus.cc:740] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.938719 21477 consensus_queue.cc:260] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.938941 21477 ts_tablet_manager.cc:1434] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.939100 21477 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c: Bootstrap starting.
I20251214 21:01:46.939323 21482 tablet_bootstrap.cc:654] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.937603 21485 consensus_queue.cc:237] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.940033 21477 tablet_bootstrap.cc:654] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.940780 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e724a1cda1d640a88514da8a6e7f80cd" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c" is_pre_election: true
I20251214 21:01:46.940897 21354 raft_consensus.cc:2468] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 0.
I20251214 21:01:46.941195 21244 leader_election.cc:304] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146bd1c0819043ffa1d129fa48b23f22, 6dfd72c36cfa496491560250746c211c; no voters: 10119fcbe5d5441da837901380471101
I20251214 21:01:46.941411 21484 raft_consensus.cc:2804] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:46.941511 21484 raft_consensus.cc:493] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:46.941563 21482 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101: No bootstrap required, opened a new log
I20251214 21:01:46.941648 21482 ts_tablet_manager.cc:1403] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:46.942078 21482 raft_consensus.cc:359] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.941551 21484 raft_consensus.cc:3060] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.942193 21176 catalog_manager.cc:5654] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10119fcbe5d5441da837901380471101 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "10119fcbe5d5441da837901380471101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:46.942181 21482 raft_consensus.cc:385] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.942834 21482 raft_consensus.cc:740] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10119fcbe5d5441da837901380471101, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.942907 21484 raft_consensus.cc:515] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.942951 21482 consensus_queue.cc:260] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.943212 21482 ts_tablet_manager.cc:1434] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:01:46.943235 21484 leader_election.cc:290] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 election: Requested vote from peers 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:46.943374 21482 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101: Bootstrap starting.
I20251214 21:01:46.941545 21477 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c: No bootstrap required, opened a new log
I20251214 21:01:46.943463 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e724a1cda1d640a88514da8a6e7f80cd" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c"
I20251214 21:01:46.943547 21477 ts_tablet_manager.cc:1403] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:01:46.943564 21354 raft_consensus.cc:3060] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.943921 21477 raft_consensus.cc:359] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.944002 21477 raft_consensus.cc:385] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.944031 21477 raft_consensus.cc:740] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.944124 21477 consensus_queue.cc:260] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.944183 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e724a1cda1d640a88514da8a6e7f80cd" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101"
I20251214 21:01:46.944278 21430 raft_consensus.cc:3060] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.944372 21477 ts_tablet_manager.cc:1434] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.944394 21354 raft_consensus.cc:2468] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 1.
I20251214 21:01:46.944537 21477 tablet_bootstrap.cc:492] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c: Bootstrap starting.
I20251214 21:01:46.944658 21244 leader_election.cc:304] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146bd1c0819043ffa1d129fa48b23f22, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:46.944666 21482 tablet_bootstrap.cc:654] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.945114 21430 raft_consensus.cc:2468] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 1.
I20251214 21:01:46.945410 21477 tablet_bootstrap.cc:654] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.945902 21482 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101: No bootstrap required, opened a new log
I20251214 21:01:46.945991 21482 ts_tablet_manager.cc:1403] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:46.946394 21482 raft_consensus.cc:359] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.946481 21484 raft_consensus.cc:2804] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:46.946487 21482 raft_consensus.cc:385] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.946571 21482 raft_consensus.cc:740] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10119fcbe5d5441da837901380471101, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.946584 21484 raft_consensus.cc:697] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 1 LEADER]: Becoming Leader. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Running, Role: LEADER
I20251214 21:01:46.946688 21484 consensus_queue.cc:237] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.946696 21482 consensus_queue.cc:260] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.946974 21482 ts_tablet_manager.cc:1434] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.947130 21482 tablet_bootstrap.cc:492] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101: Bootstrap starting.
I20251214 21:01:46.948153 21176 catalog_manager.cc:5654] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "146bd1c0819043ffa1d129fa48b23f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20251214 21:01:46.948338 21477 tablet_bootstrap.cc:492] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c: No bootstrap required, opened a new log
I20251214 21:01:46.948377 21482 tablet_bootstrap.cc:654] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:46.948410 21477 ts_tablet_manager.cc:1403] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251214 21:01:46.948829 21477 raft_consensus.cc:359] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.948922 21477 raft_consensus.cc:385] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.948945 21477 raft_consensus.cc:740] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.949072 21477 consensus_queue.cc:260] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.949308 21477 ts_tablet_manager.cc:1434] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:46.949893 21482 tablet_bootstrap.cc:492] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101: No bootstrap required, opened a new log
I20251214 21:01:46.949967 21482 ts_tablet_manager.cc:1403] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:46.950294 21482 raft_consensus.cc:359] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.950372 21482 raft_consensus.cc:385] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:46.950402 21482 raft_consensus.cc:740] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10119fcbe5d5441da837901380471101, State: Initialized, Role: FOLLOWER
I20251214 21:01:46.950510 21482 consensus_queue.cc:260] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.950708 21482 ts_tablet_manager.cc:1434] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:46.971307 21487 raft_consensus.cc:493] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:46.971468 21487 raft_consensus.cc:515] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.972002 21487 leader_election.cc:290] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:46.972713 21505 raft_consensus.cc:493] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:46.972831 21505 raft_consensus.cc:515] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.973202 21505 leader_election.cc:290] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255)
I20251214 21:01:46.973502 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272141ec18f0403ebfbe8acc05bca2f0" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22" is_pre_election: true
I20251214 21:01:46.973587 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272141ec18f0403ebfbe8acc05bca2f0" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c" is_pre_election: true
I20251214 21:01:46.973630 21279 raft_consensus.cc:2468] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 0.
I20251214 21:01:46.973692 21354 raft_consensus.cc:2468] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 0.
I20251214 21:01:46.973984 21395 leader_election.cc:304] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:46.974131 21505 raft_consensus.cc:2804] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:46.974179 21505 raft_consensus.cc:493] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:46.974215 21505 raft_consensus.cc:3060] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.975288 21505 raft_consensus.cc:515] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.975622 21505 leader_election.cc:290] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 election: Requested vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255)
I20251214 21:01:46.975845 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272141ec18f0403ebfbe8acc05bca2f0" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22"
I20251214 21:01:46.975940 21279 raft_consensus.cc:3060] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.975967 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "272141ec18f0403ebfbe8acc05bca2f0" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c"
I20251214 21:01:46.976044 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd60f0da6e6041ac96ec7093a702e92e" candidate_uuid: "6dfd72c36cfa496491560250746c211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101" is_pre_election: true
I20251214 21:01:46.976061 21354 raft_consensus.cc:3060] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.976127 21430 raft_consensus.cc:2468] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfd72c36cfa496491560250746c211c in term 0.
I20251214 21:01:46.976387 21321 leader_election.cc:304] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:46.976403 21278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd60f0da6e6041ac96ec7093a702e92e" candidate_uuid: "6dfd72c36cfa496491560250746c211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22" is_pre_election: true
I20251214 21:01:46.976519 21278 raft_consensus.cc:2468] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfd72c36cfa496491560250746c211c in term 0.
I20251214 21:01:46.976562 21487 raft_consensus.cc:2804] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:46.976604 21487 raft_consensus.cc:493] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:46.976636 21487 raft_consensus.cc:3060] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.976790 21279 raft_consensus.cc:2468] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 1.
I20251214 21:01:46.976933 21354 raft_consensus.cc:2468] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 1.
I20251214 21:01:46.977020 21396 leader_election.cc:304] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 146bd1c0819043ffa1d129fa48b23f22; no voters:
I20251214 21:01:46.977180 21505 raft_consensus.cc:2804] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:46.977260 21505 raft_consensus.cc:697] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 1 LEADER]: Becoming Leader. State: Replica: 10119fcbe5d5441da837901380471101, State: Running, Role: LEADER
I20251214 21:01:46.977382 21505 consensus_queue.cc:237] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.977435 21487 raft_consensus.cc:515] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.977774 21487 leader_election.cc:290] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [CANDIDATE]: Term 1 election: Requested vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:46.978040 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd60f0da6e6041ac96ec7093a702e92e" candidate_uuid: "6dfd72c36cfa496491560250746c211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22"
I20251214 21:01:46.978061 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd60f0da6e6041ac96ec7093a702e92e" candidate_uuid: "6dfd72c36cfa496491560250746c211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101"
I20251214 21:01:46.978133 21279 raft_consensus.cc:3060] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.978145 21430 raft_consensus.cc:3060] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:46.978849 21279 raft_consensus.cc:2468] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfd72c36cfa496491560250746c211c in term 1.
I20251214 21:01:46.979106 21321 leader_election.cc:304] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146bd1c0819043ffa1d129fa48b23f22, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:46.979048 21176 catalog_manager.cc:5654] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10119fcbe5d5441da837901380471101 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "10119fcbe5d5441da837901380471101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:46.979277 21487 raft_consensus.cc:2804] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:46.979323 21430 raft_consensus.cc:2468] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfd72c36cfa496491560250746c211c in term 1.
I20251214 21:01:46.979452 21487 raft_consensus.cc:697] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 1 LEADER]: Becoming Leader. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Running, Role: LEADER
I20251214 21:01:46.979569 21487 consensus_queue.cc:237] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:46.980999 21174 catalog_manager.cc:5654] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dfd72c36cfa496491560250746c211c (127.20.32.2). New cstate: current_term: 1 leader_uuid: "6dfd72c36cfa496491560250746c211c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20251214 21:01:47.005335 21480 raft_consensus.cc:493] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:47.005501 21480 raft_consensus.cc:515] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.006003 21480 leader_election.cc:290] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:47.006505 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89021295f5b544e2b5f7c85a79c326fb" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101" is_pre_election: true
I20251214 21:01:47.006518 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89021295f5b544e2b5f7c85a79c326fb" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c" is_pre_election: true
I20251214 21:01:47.006635 21430 raft_consensus.cc:2468] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 0.
I20251214 21:01:47.006676 21354 raft_consensus.cc:2468] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 0.
I20251214 21:01:47.006911 21245 leader_election.cc:304] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 146bd1c0819043ffa1d129fa48b23f22; no voters:
I20251214 21:01:47.007082 21480 raft_consensus.cc:2804] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:47.007143 21480 raft_consensus.cc:493] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:47.007169 21480 raft_consensus.cc:3060] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.008272 21480 raft_consensus.cc:515] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.008651 21480 leader_election.cc:290] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 election: Requested vote from peers 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:47.009016 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89021295f5b544e2b5f7c85a79c326fb" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c"
I20251214 21:01:47.009035 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89021295f5b544e2b5f7c85a79c326fb" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101"
I20251214 21:01:47.009114 21354 raft_consensus.cc:3060] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.009124 21430 raft_consensus.cc:3060] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.009931 21354 raft_consensus.cc:2468] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 1.
I20251214 21:01:47.010032 21430 raft_consensus.cc:2468] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 1.
I20251214 21:01:47.010196 21244 leader_election.cc:304] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146bd1c0819043ffa1d129fa48b23f22, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:47.010335 21480 raft_consensus.cc:2804] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:47.010419 21480 raft_consensus.cc:697] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 1 LEADER]: Becoming Leader. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Running, Role: LEADER
I20251214 21:01:47.010552 21480 consensus_queue.cc:237] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.012152 21174 catalog_manager.cc:5654] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "146bd1c0819043ffa1d129fa48b23f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20251214 21:01:47.066090 21505 raft_consensus.cc:493] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:47.066260 21505 raft_consensus.cc:515] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.066655 21505 leader_election.cc:290] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255)
I20251214 21:01:47.067103 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87237e19c05b4ad2809dfb7bf10dba6b" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22" is_pre_election: true
I20251214 21:01:47.067111 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87237e19c05b4ad2809dfb7bf10dba6b" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c" is_pre_election: true
I20251214 21:01:47.067245 21279 raft_consensus.cc:2468] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 0.
I20251214 21:01:47.067276 21354 raft_consensus.cc:2468] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 0.
I20251214 21:01:47.067612 21396 leader_election.cc:304] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 146bd1c0819043ffa1d129fa48b23f22; no voters:
I20251214 21:01:47.067816 21505 raft_consensus.cc:2804] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:47.067875 21505 raft_consensus.cc:493] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:47.067904 21505 raft_consensus.cc:3060] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.068740 21505 raft_consensus.cc:515] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.069053 21505 leader_election.cc:290] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 election: Requested vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255)
I20251214 21:01:47.069366 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87237e19c05b4ad2809dfb7bf10dba6b" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c"
I20251214 21:01:47.069363 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87237e19c05b4ad2809dfb7bf10dba6b" candidate_uuid: "10119fcbe5d5441da837901380471101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22"
I20251214 21:01:47.069474 21354 raft_consensus.cc:3060] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.069497 21279 raft_consensus.cc:3060] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.070230 21279 raft_consensus.cc:2468] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 1.
I20251214 21:01:47.070240 21354 raft_consensus.cc:2468] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10119fcbe5d5441da837901380471101 in term 1.
I20251214 21:01:47.070509 21396 leader_election.cc:304] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 146bd1c0819043ffa1d129fa48b23f22; no voters:
I20251214 21:01:47.070660 21505 raft_consensus.cc:2804] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:47.070742 21505 raft_consensus.cc:697] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 1 LEADER]: Becoming Leader. State: Replica: 10119fcbe5d5441da837901380471101, State: Running, Role: LEADER
I20251214 21:01:47.070910 21505 consensus_queue.cc:237] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.072474 21174 catalog_manager.cc:5654] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10119fcbe5d5441da837901380471101 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "10119fcbe5d5441da837901380471101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:47.162385 21487 raft_consensus.cc:493] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:47.162554 21487 raft_consensus.cc:515] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.162923 21487 leader_election.cc:290] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:47.163417 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090f9cf51a6442fdacc2f5d29baea127" candidate_uuid: "6dfd72c36cfa496491560250746c211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22" is_pre_election: true
I20251214 21:01:47.163419 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090f9cf51a6442fdacc2f5d29baea127" candidate_uuid: "6dfd72c36cfa496491560250746c211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101" is_pre_election: true
I20251214 21:01:47.163558 21279 raft_consensus.cc:2468] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfd72c36cfa496491560250746c211c in term 0.
I20251214 21:01:47.163582 21430 raft_consensus.cc:2468] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfd72c36cfa496491560250746c211c in term 0.
I20251214 21:01:47.163815 21321 leader_election.cc:304] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146bd1c0819043ffa1d129fa48b23f22, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:47.163988 21487 raft_consensus.cc:2804] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:47.164037 21487 raft_consensus.cc:493] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:47.164063 21487 raft_consensus.cc:3060] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.164872 21487 raft_consensus.cc:515] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.165158 21487 leader_election.cc:290] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [CANDIDATE]: Term 1 election: Requested vote from peers 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:47.165493 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090f9cf51a6442fdacc2f5d29baea127" candidate_uuid: "6dfd72c36cfa496491560250746c211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101"
I20251214 21:01:47.165535 21279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090f9cf51a6442fdacc2f5d29baea127" candidate_uuid: "6dfd72c36cfa496491560250746c211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146bd1c0819043ffa1d129fa48b23f22"
I20251214 21:01:47.165619 21430 raft_consensus.cc:3060] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.165633 21279 raft_consensus.cc:3060] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.166522 21430 raft_consensus.cc:2468] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfd72c36cfa496491560250746c211c in term 1.
I20251214 21:01:47.166528 21279 raft_consensus.cc:2468] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfd72c36cfa496491560250746c211c in term 1.
I20251214 21:01:47.166806 21321 leader_election.cc:304] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:47.166990 21487 raft_consensus.cc:2804] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:47.167073 21487 raft_consensus.cc:697] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 1 LEADER]: Becoming Leader. State: Replica: 6dfd72c36cfa496491560250746c211c, State: Running, Role: LEADER
I20251214 21:01:47.167213 21487 consensus_queue.cc:237] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.168694 21174 catalog_manager.cc:5654] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dfd72c36cfa496491560250746c211c (127.20.32.2). New cstate: current_term: 1 leader_uuid: "6dfd72c36cfa496491560250746c211c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20251214 21:01:47.174590 21480 raft_consensus.cc:493] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:47.174711 21480 raft_consensus.cc:515] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.175071 21480 leader_election.cc:290] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:47.175405 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d94f27f985124d7a883c4cae76287d48" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101" is_pre_election: true
I20251214 21:01:47.175405 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d94f27f985124d7a883c4cae76287d48" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c" is_pre_election: true
I20251214 21:01:47.175527 21430 raft_consensus.cc:2468] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 0.
I20251214 21:01:47.175565 21354 raft_consensus.cc:2468] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 0.
I20251214 21:01:47.175766 21245 leader_election.cc:304] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10119fcbe5d5441da837901380471101, 146bd1c0819043ffa1d129fa48b23f22; no voters:
I20251214 21:01:47.175930 21480 raft_consensus.cc:2804] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:47.175984 21480 raft_consensus.cc:493] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:47.176020 21480 raft_consensus.cc:3060] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.176748 21480 raft_consensus.cc:515] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.177022 21480 leader_election.cc:290] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 election: Requested vote from peers 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255), 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:47.177354 21354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d94f27f985124d7a883c4cae76287d48" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfd72c36cfa496491560250746c211c"
I20251214 21:01:47.177361 21430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d94f27f985124d7a883c4cae76287d48" candidate_uuid: "146bd1c0819043ffa1d129fa48b23f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10119fcbe5d5441da837901380471101"
I20251214 21:01:47.177461 21430 raft_consensus.cc:3060] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.177460 21354 raft_consensus.cc:3060] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:47.178221 21354 raft_consensus.cc:2468] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 1.
I20251214 21:01:47.178491 21244 leader_election.cc:304] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146bd1c0819043ffa1d129fa48b23f22, 6dfd72c36cfa496491560250746c211c; no voters:
I20251214 21:01:47.178534 21430 raft_consensus.cc:2468] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146bd1c0819043ffa1d129fa48b23f22 in term 1.
I20251214 21:01:47.178776 21480 raft_consensus.cc:2804] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:47.178874 21480 raft_consensus.cc:697] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 LEADER]: Becoming Leader. State: Replica: 146bd1c0819043ffa1d129fa48b23f22, State: Running, Role: LEADER
I20251214 21:01:47.178996 21480 consensus_queue.cc:237] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } }
I20251214 21:01:47.180413 21174 catalog_manager.cc:5654] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "146bd1c0819043ffa1d129fa48b23f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20251214 21:01:47.185909 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:47.187853 21524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:47.187947 21525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:47.187961 21527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:47.188066 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:47.188293 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:47.188336 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:47.188357 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746107188357 us; error 0 us; skew 500 ppm
I20251214 21:01:47.189241 20608 webserver.cc:492] Webserver started at http://127.20.32.4:33425/ using document root <none> and password file <none>
I20251214 21:01:47.189375 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:47.189424 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:47.189492 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:47.190006 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-3-root/instance:
uuid: "6dc8e2f2cf044b6786c9de42dc7691a8"
format_stamp: "Formatted at 2025-12-14 21:01:47 on dist-test-slave-bphs"
I20251214 21:01:47.191401 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:47.192255 21532 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:47.192494 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:47.192559 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-3-root
uuid: "6dc8e2f2cf044b6786c9de42dc7691a8"
format_stamp: "Formatted at 2025-12-14 21:01:47 on dist-test-slave-bphs"
I20251214 21:01:47.192625 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingTurnOffAndOn.1765746102914115-20608-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:47.196950 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:47.197279 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:47.197521 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:47.197990 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:47.198027 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:47.198067 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:47.198096 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:47.202638 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.4:35075
I20251214 21:01:47.202693 21595 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.4:35075 every 8 connection(s)
I20251214 21:01:47.206712 21596 heartbeater.cc:344] Connected to a master server at 127.20.32.62:34041
I20251214 21:01:47.206810 21596 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:47.207018 21596 heartbeater.cc:507] Master 127.20.32.62:34041 requested a full tablet report, sending...
I20251214 21:01:47.207587 21174 ts_manager.cc:194] Registered new tserver with Master: 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4:35075)
I20251214 21:01:47.208098 21174 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51000
I20251214 21:01:47.327770 21505 consensus_queue.cc:1048] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.331457 21601 consensus_queue.cc:1048] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.345191 21480 consensus_queue.cc:1048] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.348538 21606 consensus_queue.cc:1048] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.400949 21487 consensus_queue.cc:1048] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.404721 21609 consensus_queue.cc:1048] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.441937 21606 consensus_queue.cc:1048] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.444645 21484 consensus_queue.cc:1048] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.467880 21601 consensus_queue.cc:1048] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.470505 21505 consensus_queue.cc:1048] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.484560 21505 consensus_queue.cc:1048] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.487335 21505 consensus_queue.cc:1048] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.563413 21609 consensus_queue.cc:1048] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.564100 21609 consensus_queue.cc:1048] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.661494 21606 consensus_queue.cc:1048] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.664758 21606 consensus_queue.cc:1048] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:47.689687 21230 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:01:47.691001 21230 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:01:47.691160 21230 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:01:48.208959 21596 heartbeater.cc:499] Master 127.20.32.62:34041 was elected leader, sending a full tablet report...
I20251214 21:01:49.691479 21230 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:01:49.692308 21230 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:01:49.692390 21230 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:01:51.692700 21230 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:01:51.693603 21230 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:01:51.693729 21230 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:01:52.699398 21430 consensus_queue.cc:237] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } attrs { replace: true } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:52.701097 21279 raft_consensus.cc:1275] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Refusing update from remote peer 10119fcbe5d5441da837901380471101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:52.701292 21354 raft_consensus.cc:1275] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Refusing update from remote peer 10119fcbe5d5441da837901380471101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:52.701472 21627 consensus_queue.cc:1048] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:01:52.701665 21626 consensus_queue.cc:1048] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:01:52.703569 21601 raft_consensus.cc:2955] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } attrs { replace: true } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.703924 21354 raft_consensus.cc:2955] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } attrs { replace: true } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
W20251214 21:01:52.705331 21395 consensus_peers.cc:597] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 -> Peer 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4:35075): Couldn't send request to peer 6dc8e2f2cf044b6786c9de42dc7691a8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 272141ec18f0403ebfbe8acc05bca2f0. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:01:52.706251 21174 catalog_manager.cc:5654] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c reported cstate change: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "10119fcbe5d5441da837901380471101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } attrs { replace: true } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.706807 21430 consensus_queue.cc:237] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } attrs { replace: true } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:52.707301 21279 raft_consensus.cc:2955] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } attrs { replace: true } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.708720 21278 raft_consensus.cc:1275] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Refusing update from remote peer 10119fcbe5d5441da837901380471101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251214 21:01:52.708792 21395 consensus_peers.cc:597] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 -> Peer 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4:35075): Couldn't send request to peer 6dc8e2f2cf044b6786c9de42dc7691a8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f794bb9a3570451caa69144941b3f449. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:01:52.709112 21627 consensus_queue.cc:1048] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:01:52.709656 21354 raft_consensus.cc:1275] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Refusing update from remote peer 10119fcbe5d5441da837901380471101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:52.710059 21627 consensus_queue.cc:1048] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:01:52.710942 21601 raft_consensus.cc:2955] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } attrs { replace: true } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.711336 21278 raft_consensus.cc:2955] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } attrs { replace: true } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.712682 21354 raft_consensus.cc:2955] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } attrs { replace: true } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.713367 21175 catalog_manager.cc:5654] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 reported cstate change: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "10119fcbe5d5441da837901380471101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } attrs { replace: true } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.718060 21354 consensus_queue.cc:237] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:52.719377 21278 raft_consensus.cc:1275] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Refusing update from remote peer 6dfd72c36cfa496491560250746c211c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:52.719516 21429 raft_consensus.cc:1275] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Refusing update from remote peer 6dfd72c36cfa496491560250746c211c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:52.719810 21622 consensus_queue.cc:1048] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:01:52.720021 21644 consensus_queue.cc:1048] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [LEADER]: Connected to new peer: Peer: permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:01:52.721930 21643 raft_consensus.cc:2955] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.722301 21278 raft_consensus.cc:2955] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.722332 21429 raft_consensus.cc:2955] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.724715 21176 catalog_manager.cc:5654] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 reported cstate change: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "6dfd72c36cfa496491560250746c211c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
W20251214 21:01:52.726933 21320 consensus_peers.cc:597] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c -> Peer 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4:35075): Couldn't send request to peer 6dc8e2f2cf044b6786c9de42dc7691a8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 090f9cf51a6442fdacc2f5d29baea127. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:01:52.730428 21278 consensus_queue.cc:237] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:52.732146 21429 raft_consensus.cc:1275] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Refusing update from remote peer 146bd1c0819043ffa1d129fa48b23f22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:52.732250 21354 raft_consensus.cc:1275] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Refusing update from remote peer 146bd1c0819043ffa1d129fa48b23f22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:52.732525 21651 consensus_queue.cc:1048] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:01:52.732882 21651 consensus_queue.cc:1048] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:01:52.734449 21650 raft_consensus.cc:2955] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.734714 21429 raft_consensus.cc:2955] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
W20251214 21:01:52.736104 21244 consensus_peers.cc:597] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 -> Peer 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4:35075): Couldn't send request to peer 6dc8e2f2cf044b6786c9de42dc7691a8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e724a1cda1d640a88514da8a6e7f80cd. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:01:52.736383 21354 raft_consensus.cc:2955] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } } }
I20251214 21:01:52.736896 21175 catalog_manager.cc:5654] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 reported cstate change: config changed from index -1 to 2, NON_VOTER 6dc8e2f2cf044b6786c9de42dc7691a8 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "146bd1c0819043ffa1d129fa48b23f22" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:01:53.107654 21655 ts_tablet_manager.cc:933] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: Initiating tablet copy from peer 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:53.108282 21655 tablet_copy_client.cc:323] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:39321
I20251214 21:01:53.112185 21440 tablet_copy_service.cc:140] P 10119fcbe5d5441da837901380471101: Received BeginTabletCopySession request for tablet f794bb9a3570451caa69144941b3f449 from peer 6dc8e2f2cf044b6786c9de42dc7691a8 ({username='slave'} at 127.0.0.1:57746)
I20251214 21:01:53.112301 21440 tablet_copy_service.cc:161] P 10119fcbe5d5441da837901380471101: Beginning new tablet copy session on tablet f794bb9a3570451caa69144941b3f449 from peer 6dc8e2f2cf044b6786c9de42dc7691a8 at {username='slave'} at 127.0.0.1:57746: session id = 6dc8e2f2cf044b6786c9de42dc7691a8-f794bb9a3570451caa69144941b3f449
I20251214 21:01:53.113525 21440 tablet_copy_source_session.cc:215] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:01:53.114708 21655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f794bb9a3570451caa69144941b3f449. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:53.116964 21655 tablet_copy_client.cc:806] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Starting download of 0 data blocks...
I20251214 21:01:53.117129 21655 tablet_copy_client.cc:670] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Starting download of 1 WAL segments...
I20251214 21:01:53.118649 21655 tablet_copy_client.cc:538] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:01:53.120175 21655 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap starting.
I20251214 21:01:53.125785 21655 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:01:53.126070 21655 tablet_bootstrap.cc:492] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap complete.
I20251214 21:01:53.126232 21655 ts_tablet_manager.cc:1403] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.005s
I20251214 21:01:53.126688 21655 raft_consensus.cc:359] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } attrs { replace: true } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:53.126847 21655 raft_consensus.cc:740] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6dc8e2f2cf044b6786c9de42dc7691a8, State: Initialized, Role: LEARNER
I20251214 21:01:53.126955 21655 consensus_queue.cc:260] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } attrs { replace: true } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:53.127288 21655 ts_tablet_manager.cc:1434] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251214 21:01:53.127714 21440 tablet_copy_service.cc:342] P 10119fcbe5d5441da837901380471101: Request end of tablet copy session 6dc8e2f2cf044b6786c9de42dc7691a8-f794bb9a3570451caa69144941b3f449 received from {username='slave'} at 127.0.0.1:57746
I20251214 21:01:53.127820 21440 tablet_copy_service.cc:434] P 10119fcbe5d5441da837901380471101: ending tablet copy session 6dc8e2f2cf044b6786c9de42dc7691a8-f794bb9a3570451caa69144941b3f449 on tablet f794bb9a3570451caa69144941b3f449 with peer 6dc8e2f2cf044b6786c9de42dc7691a8
I20251214 21:01:53.150796 21655 ts_tablet_manager.cc:933] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: Initiating tablet copy from peer 146bd1c0819043ffa1d129fa48b23f22 (127.20.32.1:45243)
I20251214 21:01:53.151188 21655 tablet_copy_client.cc:323] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.1:45243
I20251214 21:01:53.154922 21289 tablet_copy_service.cc:140] P 146bd1c0819043ffa1d129fa48b23f22: Received BeginTabletCopySession request for tablet e724a1cda1d640a88514da8a6e7f80cd from peer 6dc8e2f2cf044b6786c9de42dc7691a8 ({username='slave'} at 127.0.0.1:55140)
I20251214 21:01:53.155053 21289 tablet_copy_service.cc:161] P 146bd1c0819043ffa1d129fa48b23f22: Beginning new tablet copy session on tablet e724a1cda1d640a88514da8a6e7f80cd from peer 6dc8e2f2cf044b6786c9de42dc7691a8 at {username='slave'} at 127.0.0.1:55140: session id = 6dc8e2f2cf044b6786c9de42dc7691a8-e724a1cda1d640a88514da8a6e7f80cd
I20251214 21:01:53.156000 21289 tablet_copy_source_session.cc:215] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:01:53.156840 21655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e724a1cda1d640a88514da8a6e7f80cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:53.159176 21655 tablet_copy_client.cc:806] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Starting download of 0 data blocks...
I20251214 21:01:53.159373 21655 tablet_copy_client.cc:670] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Starting download of 1 WAL segments...
I20251214 21:01:53.160897 21655 tablet_copy_client.cc:538] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:01:53.162523 21655 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap starting.
I20251214 21:01:53.167265 21655 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:01:53.167593 21655 tablet_bootstrap.cc:492] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap complete.
I20251214 21:01:53.167783 21655 ts_tablet_manager.cc:1403] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251214 21:01:53.168277 21655 raft_consensus.cc:359] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:53.168412 21655 raft_consensus.cc:740] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6dc8e2f2cf044b6786c9de42dc7691a8, State: Initialized, Role: LEARNER
I20251214 21:01:53.168507 21655 consensus_queue.cc:260] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:53.168809 21655 ts_tablet_manager.cc:1434] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:53.169257 21289 tablet_copy_service.cc:342] P 146bd1c0819043ffa1d129fa48b23f22: Request end of tablet copy session 6dc8e2f2cf044b6786c9de42dc7691a8-e724a1cda1d640a88514da8a6e7f80cd received from {username='slave'} at 127.0.0.1:55140
I20251214 21:01:53.169324 21289 tablet_copy_service.cc:434] P 146bd1c0819043ffa1d129fa48b23f22: ending tablet copy session 6dc8e2f2cf044b6786c9de42dc7691a8-e724a1cda1d640a88514da8a6e7f80cd on tablet e724a1cda1d640a88514da8a6e7f80cd with peer 6dc8e2f2cf044b6786c9de42dc7691a8
I20251214 21:01:53.214967 21655 ts_tablet_manager.cc:933] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: Initiating tablet copy from peer 10119fcbe5d5441da837901380471101 (127.20.32.3:39321)
I20251214 21:01:53.215317 21655 tablet_copy_client.cc:323] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:39321
I20251214 21:01:53.215667 21440 tablet_copy_service.cc:140] P 10119fcbe5d5441da837901380471101: Received BeginTabletCopySession request for tablet 272141ec18f0403ebfbe8acc05bca2f0 from peer 6dc8e2f2cf044b6786c9de42dc7691a8 ({username='slave'} at 127.0.0.1:57746)
I20251214 21:01:53.215766 21440 tablet_copy_service.cc:161] P 10119fcbe5d5441da837901380471101: Beginning new tablet copy session on tablet 272141ec18f0403ebfbe8acc05bca2f0 from peer 6dc8e2f2cf044b6786c9de42dc7691a8 at {username='slave'} at 127.0.0.1:57746: session id = 6dc8e2f2cf044b6786c9de42dc7691a8-272141ec18f0403ebfbe8acc05bca2f0
I20251214 21:01:53.216691 21440 tablet_copy_source_session.cc:215] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:01:53.217433 21655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272141ec18f0403ebfbe8acc05bca2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:53.219226 21655 tablet_copy_client.cc:806] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Starting download of 0 data blocks...
I20251214 21:01:53.219372 21655 tablet_copy_client.cc:670] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Starting download of 1 WAL segments...
I20251214 21:01:53.220342 21655 tablet_copy_client.cc:538] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:01:53.221434 21655 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap starting.
I20251214 21:01:53.225677 21655 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:01:53.225998 21655 tablet_bootstrap.cc:492] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap complete.
I20251214 21:01:53.226235 21655 ts_tablet_manager.cc:1403] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.002s
I20251214 21:01:53.226964 21655 raft_consensus.cc:359] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } attrs { replace: true } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:53.227110 21655 raft_consensus.cc:740] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6dc8e2f2cf044b6786c9de42dc7691a8, State: Initialized, Role: LEARNER
I20251214 21:01:53.227210 21655 consensus_queue.cc:260] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } attrs { replace: true } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:53.227484 21655 ts_tablet_manager.cc:1434] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:01:53.227890 21440 tablet_copy_service.cc:342] P 10119fcbe5d5441da837901380471101: Request end of tablet copy session 6dc8e2f2cf044b6786c9de42dc7691a8-272141ec18f0403ebfbe8acc05bca2f0 received from {username='slave'} at 127.0.0.1:57746
I20251214 21:01:53.227967 21440 tablet_copy_service.cc:434] P 10119fcbe5d5441da837901380471101: ending tablet copy session 6dc8e2f2cf044b6786c9de42dc7691a8-272141ec18f0403ebfbe8acc05bca2f0 on tablet 272141ec18f0403ebfbe8acc05bca2f0 with peer 6dc8e2f2cf044b6786c9de42dc7691a8
I20251214 21:01:53.239094 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
W20251214 21:01:53.240183 21163 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20251214 21:01:53.241084 21224 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251214 21:01:53.241160 21224 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251214 21:01:53.243927 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:53.244081 20608 tablet_replica.cc:333] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22: stopping tablet replica
I20251214 21:01:53.244216 20608 raft_consensus.cc:2243] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.244381 20608 raft_consensus.cc:2272] T 89021295f5b544e2b5f7c85a79c326fb P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.244485 21655 ts_tablet_manager.cc:933] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: Initiating tablet copy from peer 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255)
I20251214 21:01:53.244843 21655 tablet_copy_client.cc:323] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:38255
I20251214 21:01:53.244854 20608 tablet_replica.cc:333] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22: stopping tablet replica
I20251214 21:01:53.244974 20608 raft_consensus.cc:2243] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.245332 20608 raft_consensus.cc:2272] T d94f27f985124d7a883c4cae76287d48 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.245937 20608 tablet_replica.cc:333] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22: stopping tablet replica
I20251214 21:01:53.246089 20608 raft_consensus.cc:2243] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.246208 20608 raft_consensus.cc:2272] T 272141ec18f0403ebfbe8acc05bca2f0 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.246726 20608 tablet_replica.cc:333] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22: stopping tablet replica
I20251214 21:01:53.247188 20608 raft_consensus.cc:2243] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.247488 20608 raft_consensus.cc:2272] T e724a1cda1d640a88514da8a6e7f80cd P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.248404 20608 tablet_replica.cc:333] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22: stopping tablet replica
I20251214 21:01:53.248558 20608 raft_consensus.cc:2243] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.248735 20608 raft_consensus.cc:2272] T f794bb9a3570451caa69144941b3f449 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.249377 20608 tablet_replica.cc:333] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22: stopping tablet replica
I20251214 21:01:53.249473 20608 raft_consensus.cc:2243] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.249868 21365 tablet_copy_service.cc:140] P 6dfd72c36cfa496491560250746c211c: Received BeginTabletCopySession request for tablet 090f9cf51a6442fdacc2f5d29baea127 from peer 6dc8e2f2cf044b6786c9de42dc7691a8 ({username='slave'} at 127.0.0.1:50758)
I20251214 21:01:53.249887 20608 raft_consensus.cc:2272] T fd60f0da6e6041ac96ec7093a702e92e P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.249961 21365 tablet_copy_service.cc:161] P 6dfd72c36cfa496491560250746c211c: Beginning new tablet copy session on tablet 090f9cf51a6442fdacc2f5d29baea127 from peer 6dc8e2f2cf044b6786c9de42dc7691a8 at {username='slave'} at 127.0.0.1:50758: session id = 6dc8e2f2cf044b6786c9de42dc7691a8-090f9cf51a6442fdacc2f5d29baea127
I20251214 21:01:53.250242 20608 tablet_replica.cc:333] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22: stopping tablet replica
I20251214 21:01:53.250332 20608 raft_consensus.cc:2243] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.250437 20608 raft_consensus.cc:2272] T 090f9cf51a6442fdacc2f5d29baea127 P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.250838 21365 tablet_copy_source_session.cc:215] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:01:53.250849 20608 tablet_replica.cc:333] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22: stopping tablet replica
I20251214 21:01:53.250953 20608 raft_consensus.cc:2243] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.251035 20608 raft_consensus.cc:2272] T 87237e19c05b4ad2809dfb7bf10dba6b P 146bd1c0819043ffa1d129fa48b23f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.251621 21655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090f9cf51a6442fdacc2f5d29baea127. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:53.254170 21655 tablet_copy_client.cc:806] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Starting download of 0 data blocks...
I20251214 21:01:53.254379 21655 tablet_copy_client.cc:670] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Starting download of 1 WAL segments...
I20251214 21:01:53.255439 21655 tablet_copy_client.cc:538] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:01:53.255796 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:01:53.256623 21655 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap starting.
I20251214 21:01:53.258618 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:01:53.260013 21655 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:01:53.260321 21655 tablet_bootstrap.cc:492] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: Bootstrap complete.
I20251214 21:01:53.260541 21655 ts_tablet_manager.cc:1403] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.003s
I20251214 21:01:53.260968 20608 tablet_copy_service.cc:362] P 6dfd72c36cfa496491560250746c211c: Destroying tablet copy session 6dc8e2f2cf044b6786c9de42dc7691a8-090f9cf51a6442fdacc2f5d29baea127 due to service shutdown
W20251214 21:01:53.260885 21224 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251214 21:01:53.261032 20608 tablet_copy_service.cc:434] P 6dfd72c36cfa496491560250746c211c: ending tablet copy session 6dc8e2f2cf044b6786c9de42dc7691a8-090f9cf51a6442fdacc2f5d29baea127 on tablet 090f9cf51a6442fdacc2f5d29baea127 with peer 6dc8e2f2cf044b6786c9de42dc7691a8
W20251214 21:01:53.261055 21224 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251214 21:01:53.261106 21655 raft_consensus.cc:359] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:53.261222 21655 raft_consensus.cc:740] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6dc8e2f2cf044b6786c9de42dc7691a8, State: Initialized, Role: LEARNER
I20251214 21:01:53.261336 21655 consensus_queue.cc:260] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "146bd1c0819043ffa1d129fa48b23f22" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 45243 } } peers { permanent_uuid: "6dfd72c36cfa496491560250746c211c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38255 } } peers { permanent_uuid: "10119fcbe5d5441da837901380471101" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39321 } attrs { replace: true } } peers { permanent_uuid: "6dc8e2f2cf044b6786c9de42dc7691a8" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 35075 } attrs { promote: true } }
I20251214 21:01:53.261660 21655 ts_tablet_manager.cc:1434] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:53.266360 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:53.266585 20608 tablet_replica.cc:333] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c: stopping tablet replica
I20251214 21:01:53.266790 20608 raft_consensus.cc:2243] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.266920 20608 raft_consensus.cc:2272] T 87237e19c05b4ad2809dfb7bf10dba6b P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus is shut down!
W20251214 21:01:53.266947 21395 consensus_peers.cc:597] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 -> Peer 6dfd72c36cfa496491560250746c211c (127.20.32.2:38255): Couldn't send request to peer 6dfd72c36cfa496491560250746c211c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:01:53.267527 20608 tablet_replica.cc:333] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c: stopping tablet replica
I20251214 21:01:53.267648 20608 raft_consensus.cc:2243] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.267868 20608 raft_consensus.cc:2272] T 090f9cf51a6442fdacc2f5d29baea127 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.268343 20608 tablet_replica.cc:333] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c: stopping tablet replica
I20251214 21:01:53.268452 20608 raft_consensus.cc:2243] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.268543 20608 raft_consensus.cc:2272] T 89021295f5b544e2b5f7c85a79c326fb P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.268890 20608 tablet_replica.cc:333] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c: stopping tablet replica
I20251214 21:01:53.268977 20608 raft_consensus.cc:2243] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.269078 20608 raft_consensus.cc:2272] T f794bb9a3570451caa69144941b3f449 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.269505 20608 tablet_replica.cc:333] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c: stopping tablet replica
I20251214 21:01:53.269594 20608 raft_consensus.cc:2243] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.269692 20608 raft_consensus.cc:2272] T e724a1cda1d640a88514da8a6e7f80cd P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.270157 20608 tablet_replica.cc:333] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c: stopping tablet replica
I20251214 21:01:53.270248 20608 raft_consensus.cc:2243] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.270344 20608 raft_consensus.cc:2272] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.270799 20608 tablet_replica.cc:333] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c: stopping tablet replica
I20251214 21:01:53.270876 20608 raft_consensus.cc:2243] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.270962 20608 raft_consensus.cc:2272] T d94f27f985124d7a883c4cae76287d48 P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.271277 20608 tablet_replica.cc:333] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c: stopping tablet replica
I20251214 21:01:53.271368 20608 raft_consensus.cc:2243] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.271517 20608 raft_consensus.cc:2272] T fd60f0da6e6041ac96ec7093a702e92e P 6dfd72c36cfa496491560250746c211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.285851 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:01:53.289438 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
W20251214 21:01:53.290779 21224 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251214 21:01:53.291035 21224 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251214 21:01:53.292243 21224 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251214 21:01:53.292374 21224 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251214 21:01:53.294665 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:53.294880 20608 tablet_replica.cc:333] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101: stopping tablet replica
I20251214 21:01:53.295003 20608 raft_consensus.cc:2243] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.295118 20608 raft_consensus.cc:2272] T 89021295f5b544e2b5f7c85a79c326fb P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.295543 20608 tablet_replica.cc:333] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101: stopping tablet replica
I20251214 21:01:53.295642 20608 raft_consensus.cc:2243] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.295750 20608 raft_consensus.cc:2272] T 090f9cf51a6442fdacc2f5d29baea127 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.296226 20608 tablet_replica.cc:333] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101: stopping tablet replica
I20251214 21:01:53.296327 20608 raft_consensus.cc:2243] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.296564 20608 raft_consensus.cc:2272] T 87237e19c05b4ad2809dfb7bf10dba6b P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.296885 20608 tablet_replica.cc:333] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101: stopping tablet replica
I20251214 21:01:53.296972 20608 raft_consensus.cc:2243] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.297153 20608 raft_consensus.cc:2272] T 272141ec18f0403ebfbe8acc05bca2f0 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.297580 20608 tablet_replica.cc:333] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101: stopping tablet replica
I20251214 21:01:53.297663 20608 raft_consensus.cc:2243] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.297780 20608 raft_consensus.cc:2272] T d94f27f985124d7a883c4cae76287d48 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.298079 20608 tablet_replica.cc:333] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101: stopping tablet replica
I20251214 21:01:53.298156 20608 raft_consensus.cc:2243] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.298242 20608 raft_consensus.cc:2272] T fd60f0da6e6041ac96ec7093a702e92e P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.298519 20608 tablet_replica.cc:333] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101: stopping tablet replica
I20251214 21:01:53.298594 20608 raft_consensus.cc:2243] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.298767 20608 raft_consensus.cc:2272] T f794bb9a3570451caa69144941b3f449 P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.299191 20608 tablet_replica.cc:333] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101: stopping tablet replica
I20251214 21:01:53.299266 20608 raft_consensus.cc:2243] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:53.299361 20608 raft_consensus.cc:2272] T e724a1cda1d640a88514da8a6e7f80cd P 10119fcbe5d5441da837901380471101 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251214 21:01:53.306901 21655 tablet_copy_client.cc:1130] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.20.32.2:38255: connect: Connection refused (error 111)
I20251214 21:01:53.313068 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:01:53.315740 20608 tablet_server.cc:178] TabletServer@127.20.32.4:0 shutting down...
I20251214 21:01:53.319847 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:53.320109 20608 tablet_replica.cc:333] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8: stopping tablet replica
I20251214 21:01:53.320263 20608 raft_consensus.cc:2243] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Raft consensus shutting down.
I20251214 21:01:53.320390 20608 raft_consensus.cc:2272] T 090f9cf51a6442fdacc2f5d29baea127 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Raft consensus is shut down!
I20251214 21:01:53.320927 20608 tablet_replica.cc:333] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8: stopping tablet replica
I20251214 21:01:53.321022 20608 raft_consensus.cc:2243] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Raft consensus shutting down.
I20251214 21:01:53.321115 20608 raft_consensus.cc:2272] T 272141ec18f0403ebfbe8acc05bca2f0 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Raft consensus is shut down!
I20251214 21:01:53.321484 20608 tablet_replica.cc:333] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8: stopping tablet replica
I20251214 21:01:53.321568 20608 raft_consensus.cc:2243] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Raft consensus shutting down.
I20251214 21:01:53.321653 20608 raft_consensus.cc:2272] T f794bb9a3570451caa69144941b3f449 P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Raft consensus is shut down!
I20251214 21:01:53.322070 20608 tablet_replica.cc:333] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8: stopping tablet replica
I20251214 21:01:53.322149 20608 raft_consensus.cc:2243] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Raft consensus shutting down.
I20251214 21:01:53.322237 20608 raft_consensus.cc:2272] T e724a1cda1d640a88514da8a6e7f80cd P 6dc8e2f2cf044b6786c9de42dc7691a8 [term 1 LEARNER]: Raft consensus is shut down!
I20251214 21:01:53.335969 20608 tablet_server.cc:195] TabletServer@127.20.32.4:0 shutdown complete.
I20251214 21:01:53.338306 20608 master.cc:561] Master@127.20.32.62:34041 shutting down...
I20251214 21:01:53.341638 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:53.341872 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:53.341944 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 71202ad58321488d91d3ea6cf44cf525: stopping tablet replica
I20251214 21:01:53.354884 20608 master.cc:583] Master@127.20.32.62:34041 shutdown complete.
[ OK ] AutoRebalancerTest.AutoRebalancingTurnOffAndOn (7704 ms)
[ RUN ] AutoRebalancerTest.NextLeaderResumesAutoRebalancing
I20251214 21:01:53.365118 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:45711,127.20.32.61:34711,127.20.32.60:34193
I20251214 21:01:53.365536 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:01:53.367650 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:53.367722 21670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.367712 21673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.367691 21671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.368132 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:53.368172 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:53.368186 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746113368186 us; error 0 us; skew 500 ppm
I20251214 21:01:53.368981 20608 webserver.cc:492] Webserver started at http://127.20.32.62:35875/ using document root <none> and password file <none>
I20251214 21:01:53.369117 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:53.369164 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:53.369239 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:53.369588 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "f6b8aa1417fa45158b59f5200ffdeaaf"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.370956 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:53.371771 21678 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.371984 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:53.372047 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "f6b8aa1417fa45158b59f5200ffdeaaf"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.372113 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:53.396981 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:53.397349 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:53.401499 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:45711
I20251214 21:01:53.402817 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:01:53.407588 21730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:45711 every 8 connection(s)
I20251214 21:01:53.408641 21731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20251214 21:01:53.408818 21733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.408812 21736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.409179 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:53.410559 21731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
W20251214 21:01:53.411947 21734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.412217 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:53.412276 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:53.412298 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746113412298 us; error 0 us; skew 500 ppm
I20251214 21:01:53.413357 20608 webserver.cc:492] Webserver started at http://127.20.32.61:45083/ using document root <none> and password file <none>
I20251214 21:01:53.413519 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:53.413578 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:53.413652 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:53.414124 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root/instance:
uuid: "7f634844362e4093920b23151cc858ac"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.415472 21731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:53.415810 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:53.416801 21744 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20251214 21:01:53.416813 21731 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.32.61:34711: Network error: Client connection negotiation failed: client connection to 127.20.32.61:34711: connect: Connection refused (error 111)
I20251214 21:01:53.417145 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:53.417201 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root
uuid: "7f634844362e4093920b23151cc858ac"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.417261 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:53.431100 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:53.431505 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:53.435320 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.61:34711
I20251214 21:01:53.435442 21796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.61:34711 every 8 connection(s)
I20251214 21:01:53.436009 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:01:53.436208 21797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:53.437557 21797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
W20251214 21:01:53.437620 21799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.437808 21802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.437916 21800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.438133 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:53.438315 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:53.438462 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:53.438516 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746113438515 us; error 0 us; skew 500 ppm
I20251214 21:01:53.439445 20608 webserver.cc:492] Webserver started at http://127.20.32.60:38463/ using document root <none> and password file <none>
I20251214 21:01:53.439586 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:53.439633 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:53.439695 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:53.440053 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root/instance:
uuid: "4502aeb6eac54371b2a11b7e25caab1d"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.441606 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:53.441882 21797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:53.442658 21808 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.442966 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:53.443039 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root
uuid: "4502aeb6eac54371b2a11b7e25caab1d"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.443099 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:53.446341 21797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } has no permanent_uuid. Determining permanent_uuid...
W20251214 21:01:53.447494 21797 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.32.60:34193: Network error: Client connection negotiation failed: client connection to 127.20.32.60:34193: connect: Connection refused (error 111)
I20251214 21:01:53.473057 21731 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } attempt: 1
I20251214 21:01:53.473287 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:53.473727 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:53.477411 21731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:53.478303 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.60:34193
I20251214 21:01:53.478335 21862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.60:34193 every 8 connection(s)
I20251214 21:01:53.478757 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:01:53.479117 21863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:53.480146 21863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:53.482888 21731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf: Bootstrap starting.
I20251214 21:01:53.483744 21731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:53.483939 21863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:53.484810 21731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf: No bootstrap required, opened a new log
I20251214 21:01:53.485217 21731 raft_consensus.cc:359] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.485328 21731 raft_consensus.cc:385] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:53.485358 21731 raft_consensus.cc:740] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6b8aa1417fa45158b59f5200ffdeaaf, State: Initialized, Role: FOLLOWER
I20251214 21:01:53.485495 21731 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.485822 21868 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.485916 21868 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:53.486028 21731 sys_catalog.cc:565] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:01:53.487771 21863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } has no permanent_uuid. Determining permanent_uuid...
I20251214 21:01:53.487848 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20251214 21:01:53.488484 21879 catalog_manager.cc:1568] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251214 21:01:53.488541 21879 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251214 21:01:53.492177 21863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: Bootstrap starting.
I20251214 21:01:53.492995 21863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:53.493650 21797 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } attempt: 1
I20251214 21:01:53.494102 21863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: No bootstrap required, opened a new log
I20251214 21:01:53.494482 21863 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.494570 21863 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:53.494591 21863 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4502aeb6eac54371b2a11b7e25caab1d, State: Initialized, Role: FOLLOWER
I20251214 21:01:53.494704 21863 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.495031 21881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.495138 21881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:53.495201 21863 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: configured and running, proceeding with master startup.
W20251214 21:01:53.497557 21892 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251214 21:01:53.497625 21892 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251214 21:01:53.498320 21797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac: Bootstrap starting.
I20251214 21:01:53.499181 21797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:53.500182 21797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac: No bootstrap required, opened a new log
I20251214 21:01:53.500548 21797 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.500633 21797 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:53.500654 21797 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f634844362e4093920b23151cc858ac, State: Initialized, Role: FOLLOWER
I20251214 21:01:53.500751 21797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.501024 21894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.501114 21894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:53.501125 21797 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:01:53.502723 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20251214 21:01:53.503252 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:53.503283 21905 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251214 21:01:53.503324 21905 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20251214 21:01:53.505082 21907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.505182 21906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.505230 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:53.505247 21909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.505642 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:53.505688 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:53.505733 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746113505733 us; error 0 us; skew 500 ppm
I20251214 21:01:53.506537 20608 webserver.cc:492] Webserver started at http://127.20.32.1:38263/ using document root <none> and password file <none>
I20251214 21:01:53.506654 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:53.506690 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:53.506742 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:53.507087 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "8a8a20bc870c4937aa7c196684a9853f"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.508404 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:53.509318 21914 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.509598 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:53.509658 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "8a8a20bc870c4937aa7c196684a9853f"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.509732 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:53.523384 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:53.523814 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:53.524106 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:53.524577 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:53.524616 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.524648 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:53.524677 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.529102 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:40791
I20251214 21:01:53.529187 21977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:40791 every 8 connection(s)
I20251214 21:01:53.530104 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:53.532809 21986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.532882 21985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.533650 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:53.534439 21988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.534708 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:53.534783 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:53.534813 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746113534812 us; error 0 us; skew 500 ppm
I20251214 21:01:53.534971 21980 heartbeater.cc:344] Connected to a master server at 127.20.32.61:34711
I20251214 21:01:53.535076 21980 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.535151 21978 heartbeater.cc:344] Connected to a master server at 127.20.32.60:34193
I20251214 21:01:53.535208 21978 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.535344 21978 heartbeater.cc:507] Master 127.20.32.60:34193 requested a full tablet report, sending...
I20251214 21:01:53.535337 21979 heartbeater.cc:344] Connected to a master server at 127.20.32.62:45711
I20251214 21:01:53.535339 21980 heartbeater.cc:507] Master 127.20.32.61:34711 requested a full tablet report, sending...
I20251214 21:01:53.535449 21979 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.535776 21979 heartbeater.cc:507] Master 127.20.32.62:45711 requested a full tablet report, sending...
I20251214 21:01:53.536036 20608 webserver.cc:492] Webserver started at http://127.20.32.2:39893/ using document root <none> and password file <none>
I20251214 21:01:53.536046 21827 ts_manager.cc:194] Registered new tserver with Master: 8a8a20bc870c4937aa7c196684a9853f (127.20.32.1:40791)
I20251214 21:01:53.536202 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:53.536264 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:53.536334 21695 ts_manager.cc:194] Registered new tserver with Master: 8a8a20bc870c4937aa7c196684a9853f (127.20.32.1:40791)
I20251214 21:01:53.536339 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:53.536046 21761 ts_manager.cc:194] Registered new tserver with Master: 8a8a20bc870c4937aa7c196684a9853f (127.20.32.1:40791)
I20251214 21:01:53.536903 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "4f6a151bbc7e4eee8df8fb8250faaabb"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.538457 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251214 21:01:53.539503 21993 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.539798 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:53.539870 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "4f6a151bbc7e4eee8df8fb8250faaabb"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.539924 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:53.548094 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:53.548486 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:53.548770 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:53.549237 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:53.549275 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.549305 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:53.549331 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.553610 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:34399
I20251214 21:01:53.553670 22056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:34399 every 8 connection(s)
I20251214 21:01:53.554488 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:53.556928 22064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.557271 22067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:53.557614 22065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:53.558264 20608 server_base.cc:1047] running on GCE node
I20251214 21:01:53.558722 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:53.558768 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:53.558789 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746113558789 us; error 0 us; skew 500 ppm
I20251214 21:01:53.559208 22058 heartbeater.cc:344] Connected to a master server at 127.20.32.62:45711
I20251214 21:01:53.559298 22058 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.559538 22057 heartbeater.cc:344] Connected to a master server at 127.20.32.60:34193
I20251214 21:01:53.559623 22057 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.559726 20608 webserver.cc:492] Webserver started at http://127.20.32.3:33277/ using document root <none> and password file <none>
I20251214 21:01:53.559535 22058 heartbeater.cc:507] Master 127.20.32.62:45711 requested a full tablet report, sending...
I20251214 21:01:53.559803 22057 heartbeater.cc:507] Master 127.20.32.60:34193 requested a full tablet report, sending...
I20251214 21:01:53.559897 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:53.559952 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:53.560026 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:53.560118 22059 heartbeater.cc:344] Connected to a master server at 127.20.32.61:34711
I20251214 21:01:53.560439 22059 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.560457 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "bc3f96d8a34f4e18aebe7501ed434e29"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.560351 21695 ts_manager.cc:194] Registered new tserver with Master: 4f6a151bbc7e4eee8df8fb8250faaabb (127.20.32.2:34399)
I20251214 21:01:53.560353 21827 ts_manager.cc:194] Registered new tserver with Master: 4f6a151bbc7e4eee8df8fb8250faaabb (127.20.32.2:34399)
I20251214 21:01:53.560623 22059 heartbeater.cc:507] Master 127.20.32.61:34711 requested a full tablet report, sending...
I20251214 21:01:53.561185 21761 ts_manager.cc:194] Registered new tserver with Master: 4f6a151bbc7e4eee8df8fb8250faaabb (127.20.32.2:34399)
I20251214 21:01:53.562121 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:53.562992 22072 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.563203 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:53.563261 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "bc3f96d8a34f4e18aebe7501ed434e29"
format_stamp: "Formatted at 2025-12-14 21:01:53 on dist-test-slave-bphs"
I20251214 21:01:53.563304 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NextLeaderResumesAutoRebalancing.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:53.567718 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:53.568051 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:53.568292 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:53.568822 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:53.568868 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.568899 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:53.568926 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:53.570019 21868 raft_consensus.cc:493] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:53.570122 21868 raft_consensus.cc:515] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.570516 21868 leader_election.cc:290] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f634844362e4093920b23151cc858ac (127.20.32.61:34711), 4502aeb6eac54371b2a11b7e25caab1d (127.20.32.60:34193)
I20251214 21:01:53.570924 21837 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4502aeb6eac54371b2a11b7e25caab1d" is_pre_election: true
I20251214 21:01:53.570945 21770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f634844362e4093920b23151cc858ac" is_pre_election: true
I20251214 21:01:53.571045 21837 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6b8aa1417fa45158b59f5200ffdeaaf in term 0.
I20251214 21:01:53.571071 21770 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6b8aa1417fa45158b59f5200ffdeaaf in term 0.
I20251214 21:01:53.571352 21682 leader_election.cc:304] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f634844362e4093920b23151cc858ac, f6b8aa1417fa45158b59f5200ffdeaaf; no voters:
I20251214 21:01:53.571511 21868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:01:53.571573 21868 raft_consensus.cc:493] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:53.571616 21868 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:53.572775 21868 raft_consensus.cc:515] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.573154 21868 leader_election.cc:290] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [CANDIDATE]: Term 1 election: Requested vote from peers 7f634844362e4093920b23151cc858ac (127.20.32.61:34711), 4502aeb6eac54371b2a11b7e25caab1d (127.20.32.60:34193)
I20251214 21:01:53.573535 21770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f634844362e4093920b23151cc858ac"
I20251214 21:01:53.573613 21837 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4502aeb6eac54371b2a11b7e25caab1d"
I20251214 21:01:53.573648 21770 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:53.573720 21837 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:53.574409 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:40669
I20251214 21:01:53.574651 21770 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6b8aa1417fa45158b59f5200ffdeaaf in term 1.
I20251214 21:01:53.574651 21837 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6b8aa1417fa45158b59f5200ffdeaaf in term 1.
I20251214 21:01:53.574970 21682 leader_election.cc:304] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f634844362e4093920b23151cc858ac, f6b8aa1417fa45158b59f5200ffdeaaf; no voters:
I20251214 21:01:53.575021 22135 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:40669 every 8 connection(s)
I20251214 21:01:53.575227 21868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:53.575392 21868 raft_consensus.cc:697] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 1 LEADER]: Becoming Leader. State: Replica: f6b8aa1417fa45158b59f5200ffdeaaf, State: Running, Role: LEADER
I20251214 21:01:53.575536 21868 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:53.576210 21868 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6b8aa1417fa45158b59f5200ffdeaaf. Latest consensus state: current_term: 1 leader_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.576300 21868 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:53.576541 22144 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:01:53.577445 22144 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:01:53.579605 21837 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 1 FOLLOWER]: Refusing update from remote peer f6b8aa1417fa45158b59f5200ffdeaaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:53.579725 22138 heartbeater.cc:344] Connected to a master server at 127.20.32.61:34711
I20251214 21:01:53.579756 22136 heartbeater.cc:344] Connected to a master server at 127.20.32.60:34193
I20251214 21:01:53.579805 22138 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.579945 21868 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:53.580041 22138 heartbeater.cc:507] Master 127.20.32.61:34711 requested a full tablet report, sending...
I20251214 21:01:53.579804 22136 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.580471 22136 heartbeater.cc:507] Master 127.20.32.60:34193 requested a full tablet report, sending...
I20251214 21:01:53.581284 21881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6b8aa1417fa45158b59f5200ffdeaaf. Latest consensus state: current_term: 1 leader_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.581385 21881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:53.581564 21827 ts_manager.cc:194] Registered new tserver with Master: bc3f96d8a34f4e18aebe7501ed434e29 (127.20.32.3:40669)
I20251214 21:01:53.582034 21761 ts_manager.cc:194] Registered new tserver with Master: bc3f96d8a34f4e18aebe7501ed434e29 (127.20.32.3:40669)
I20251214 21:01:53.582489 21770 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 1 FOLLOWER]: Refusing update from remote peer f6b8aa1417fa45158b59f5200ffdeaaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:01:53.582759 21868 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.582808 22141 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:01:53.582861 21868 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:53.583186 21881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.583278 21881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:53.583442 22137 heartbeater.cc:344] Connected to a master server at 127.20.32.62:45711
I20251214 21:01:53.583513 22137 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:53.583731 22137 heartbeater.cc:507] Master 127.20.32.62:45711 requested a full tablet report, sending...
I20251214 21:01:53.584151 21894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6b8aa1417fa45158b59f5200ffdeaaf. Latest consensus state: current_term: 1 leader_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.584245 21894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:53.584275 21695 ts_manager.cc:194] Registered new tserver with Master: bc3f96d8a34f4e18aebe7501ed434e29 (127.20.32.3:40669)
I20251214 21:01:53.584328 21894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.584400 21894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:53.584455 22144 catalog_manager.cc:1357] Generated new cluster ID: 9f1d5dd0ba8640c3b819309cd85686aa
I20251214 21:01:53.584501 22144 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:01:53.585184 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.010276503s
I20251214 21:01:53.590315 21868 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:53.590461 21868 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:53.592180 22144 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:01:53.592888 22144 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:01:53.602411 22144 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf: Generated new TSK 0
I20251214 21:01:53.602614 22144 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:01:54.498355 21892 catalog_manager.cc:1269] Loaded cluster ID: 9f1d5dd0ba8640c3b819309cd85686aa
I20251214 21:01:54.498445 21892 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: loading cluster ID for follower catalog manager: success
I20251214 21:01:54.499536 21892 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: acquiring CA information for follower catalog manager: success
I20251214 21:01:54.500048 21892 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251214 21:01:54.503868 21905 catalog_manager.cc:1269] Loaded cluster ID: 9f1d5dd0ba8640c3b819309cd85686aa
I20251214 21:01:54.503921 21905 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac: loading cluster ID for follower catalog manager: success
I20251214 21:01:54.504964 21905 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac: acquiring CA information for follower catalog manager: success
I20251214 21:01:54.505455 21905 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251214 21:01:54.538506 21695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55360
I20251214 21:01:54.562633 21695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55364
I20251214 21:01:54.585803 21695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55378
I20251214 21:01:55.487934 21878 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:01:55.539345 21979 heartbeater.cc:499] Master 127.20.32.62:45711 was elected leader, sending a full tablet report...
I20251214 21:01:55.563405 22058 heartbeater.cc:499] Master 127.20.32.62:45711 was elected leader, sending a full tablet report...
I20251214 21:01:55.586598 22137 heartbeater.cc:499] Master 127.20.32.62:45711 was elected leader, sending a full tablet report...
I20251214 21:01:55.737534 20608 test_util.cc:276] Using random seed: -838993990
I20251214 21:01:55.746546 21695 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55386:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\252\252\252*\004\001\000TUUU""\004\001\000\252\252\252*\004\001\000TUUU"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251214 21:01:55.760447 22096 tablet_service.cc:1505] Processing CreateTablet for tablet 0fa345f6600a4ed9846bb8c479e7b842 (DEFAULT_TABLE table=test-workload [id=986a3e08b7e94d1795fdc3da241beddd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20251214 21:01:55.760777 22096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa345f6600a4ed9846bb8c479e7b842. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:55.761364 22021 tablet_service.cc:1505] Processing CreateTablet for tablet b5de42d65d874d8db408573db3b1024f (DEFAULT_TABLE table=test-workload [id=986a3e08b7e94d1795fdc3da241beddd]), partition=RANGE (key) PARTITION VALUES < 715827882
I20251214 21:01:55.761627 22021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5de42d65d874d8db408573db3b1024f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:55.761656 21942 tablet_service.cc:1505] Processing CreateTablet for tablet e3e20c92484749e9ac8baa82f6f14133 (DEFAULT_TABLE table=test-workload [id=986a3e08b7e94d1795fdc3da241beddd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20251214 21:01:55.761896 21942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e20c92484749e9ac8baa82f6f14133. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:55.763087 22186 tablet_bootstrap.cc:492] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29: Bootstrap starting.
I20251214 21:01:55.763906 22188 tablet_bootstrap.cc:492] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb: Bootstrap starting.
I20251214 21:01:55.764312 22186 tablet_bootstrap.cc:654] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:55.764901 22188 tablet_bootstrap.cc:654] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:55.765444 22187 tablet_bootstrap.cc:492] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f: Bootstrap starting.
I20251214 21:01:55.765484 22186 tablet_bootstrap.cc:492] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29: No bootstrap required, opened a new log
I20251214 21:01:55.765549 22186 ts_tablet_manager.cc:1403] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:55.766011 22186 raft_consensus.cc:359] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3f96d8a34f4e18aebe7501ed434e29" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 40669 } }
I20251214 21:01:55.766134 22186 raft_consensus.cc:385] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:55.766166 22186 raft_consensus.cc:740] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc3f96d8a34f4e18aebe7501ed434e29, State: Initialized, Role: FOLLOWER
I20251214 21:01:55.766289 22186 consensus_queue.cc:260] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3f96d8a34f4e18aebe7501ed434e29" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 40669 } }
I20251214 21:01:55.766386 22186 raft_consensus.cc:399] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:55.766428 22186 raft_consensus.cc:493] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:55.766444 22187 tablet_bootstrap.cc:654] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:55.766479 22186 raft_consensus.cc:3060] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:55.767288 22188 tablet_bootstrap.cc:492] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb: No bootstrap required, opened a new log
I20251214 21:01:55.767380 22188 ts_tablet_manager.cc:1403] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:01:55.767455 22186 raft_consensus.cc:515] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3f96d8a34f4e18aebe7501ed434e29" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 40669 } }
I20251214 21:01:55.767588 22186 leader_election.cc:304] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc3f96d8a34f4e18aebe7501ed434e29; no voters:
I20251214 21:01:55.767767 22186 leader_election.cc:290] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:55.767823 22188 raft_consensus.cc:359] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6a151bbc7e4eee8df8fb8250faaabb" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 34399 } }
I20251214 21:01:55.767863 22192 raft_consensus.cc:2804] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:55.768129 22186 ts_tablet_manager.cc:1434] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20251214 21:01:55.768190 22192 raft_consensus.cc:697] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 1 LEADER]: Becoming Leader. State: Replica: bc3f96d8a34f4e18aebe7501ed434e29, State: Running, Role: LEADER
I20251214 21:01:55.768344 22187 tablet_bootstrap.cc:492] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f: No bootstrap required, opened a new log
I20251214 21:01:55.768380 22192 consensus_queue.cc:237] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3f96d8a34f4e18aebe7501ed434e29" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 40669 } }
I20251214 21:01:55.768474 22187 ts_tablet_manager.cc:1403] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:55.768949 22187 raft_consensus.cc:359] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a8a20bc870c4937aa7c196684a9853f" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40791 } }
I20251214 21:01:55.769024 22187 raft_consensus.cc:385] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:55.769052 22187 raft_consensus.cc:740] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a8a20bc870c4937aa7c196684a9853f, State: Initialized, Role: FOLLOWER
I20251214 21:01:55.769160 22187 consensus_queue.cc:260] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a8a20bc870c4937aa7c196684a9853f" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40791 } }
I20251214 21:01:55.769233 22187 raft_consensus.cc:399] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:55.769259 22187 raft_consensus.cc:493] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:55.769285 22187 raft_consensus.cc:3060] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:55.767978 22188 raft_consensus.cc:385] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:55.769760 22188 raft_consensus.cc:740] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6a151bbc7e4eee8df8fb8250faaabb, State: Initialized, Role: FOLLOWER
I20251214 21:01:55.769896 22188 consensus_queue.cc:260] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6a151bbc7e4eee8df8fb8250faaabb" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 34399 } }
I20251214 21:01:55.769874 21695 catalog_manager.cc:5654] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc3f96d8a34f4e18aebe7501ed434e29 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "bc3f96d8a34f4e18aebe7501ed434e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3f96d8a34f4e18aebe7501ed434e29" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 40669 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:55.769965 22188 raft_consensus.cc:399] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:55.770030 22188 raft_consensus.cc:493] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:55.770088 22188 raft_consensus.cc:3060] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:55.770985 22188 raft_consensus.cc:515] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6a151bbc7e4eee8df8fb8250faaabb" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 34399 } }
I20251214 21:01:55.771040 22187 raft_consensus.cc:515] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a8a20bc870c4937aa7c196684a9853f" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40791 } }
I20251214 21:01:55.771109 22188 leader_election.cc:304] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f6a151bbc7e4eee8df8fb8250faaabb; no voters:
I20251214 21:01:55.771147 22187 leader_election.cc:304] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a8a20bc870c4937aa7c196684a9853f; no voters:
I20251214 21:01:55.771286 22188 leader_election.cc:290] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:55.771311 22187 leader_election.cc:290] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:55.771397 22196 raft_consensus.cc:2804] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:55.771587 22187 ts_tablet_manager.cc:1434] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:01:55.771632 22188 ts_tablet_manager.cc:1434] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:01:55.771600 22196 raft_consensus.cc:697] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 1 LEADER]: Becoming Leader. State: Replica: 4f6a151bbc7e4eee8df8fb8250faaabb, State: Running, Role: LEADER
I20251214 21:01:55.772802 22196 consensus_queue.cc:237] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6a151bbc7e4eee8df8fb8250faaabb" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 34399 } }
I20251214 21:01:55.774459 21693 catalog_manager.cc:5654] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6a151bbc7e4eee8df8fb8250faaabb (127.20.32.2). New cstate: current_term: 1 leader_uuid: "4f6a151bbc7e4eee8df8fb8250faaabb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6a151bbc7e4eee8df8fb8250faaabb" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 34399 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:55.776705 22197 raft_consensus.cc:2804] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:55.777611 22197 raft_consensus.cc:697] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 1 LEADER]: Becoming Leader. State: Replica: 8a8a20bc870c4937aa7c196684a9853f, State: Running, Role: LEADER
I20251214 21:01:55.777871 22197 consensus_queue.cc:237] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a8a20bc870c4937aa7c196684a9853f" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40791 } }
I20251214 21:01:55.780938 21695 catalog_manager.cc:5654] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a8a20bc870c4937aa7c196684a9853f (127.20.32.1). New cstate: current_term: 1 leader_uuid: "8a8a20bc870c4937aa7c196684a9853f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a8a20bc870c4937aa7c196684a9853f" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40791 } health_report { overall_health: HEALTHY } } }
I20251214 21:01:55.787675 20608 master.cc:561] Master@127.20.32.62:45711 shutting down...
I20251214 21:01:55.790699 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:55.790918 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:55.790984 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P f6b8aa1417fa45158b59f5200ffdeaaf: stopping tablet replica
I20251214 21:01:55.804672 20608 master.cc:583] Master@127.20.32.62:45711 shutdown complete.
W20251214 21:01:56.781579 22058 heartbeater.cc:646] Failed to heartbeat to 127.20.32.62:45711 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111)
I20251214 21:01:57.285151 22209 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6b8aa1417fa45158b59f5200ffdeaaf)
I20251214 21:01:57.285312 22209 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:57.285395 22210 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6b8aa1417fa45158b59f5200ffdeaaf)
I20251214 21:01:57.285619 22210 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:57.285800 22209 leader_election.cc:290] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711), 7f634844362e4093920b23151cc858ac (127.20.32.61:34711)
I20251214 21:01:57.286280 21770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4502aeb6eac54371b2a11b7e25caab1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "7f634844362e4093920b23151cc858ac" is_pre_election: true
I20251214 21:01:57.286401 21770 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4502aeb6eac54371b2a11b7e25caab1d in term 1.
I20251214 21:01:57.286739 21837 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f634844362e4093920b23151cc858ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "4502aeb6eac54371b2a11b7e25caab1d" is_pre_election: true
I20251214 21:01:57.286851 21837 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f634844362e4093920b23151cc858ac in term 1.
I20251214 21:01:57.286854 21813 leader_election.cc:304] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4502aeb6eac54371b2a11b7e25caab1d, 7f634844362e4093920b23151cc858ac; no voters:
I20251214 21:01:57.287173 22210 leader_election.cc:290] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711), 4502aeb6eac54371b2a11b7e25caab1d (127.20.32.60:34193)
I20251214 21:01:57.287155 21748 leader_election.cc:304] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4502aeb6eac54371b2a11b7e25caab1d, 7f634844362e4093920b23151cc858ac; no voters:
I20251214 21:01:57.287160 22209 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:01:57.287295 22209 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6b8aa1417fa45158b59f5200ffdeaaf)
I20251214 21:01:57.287333 22209 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 1 FOLLOWER]: Advancing to term 2
W20251214 21:01:57.287415 21746 leader_election.cc:336] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711): Network error: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111)
I20251214 21:01:57.287564 22210 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251214 21:01:57.287631 21811 leader_election.cc:336] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711): Network error: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111)
I20251214 21:01:57.287657 22210 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6b8aa1417fa45158b59f5200ffdeaaf)
I20251214 21:01:57.287748 22210 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:01:57.288507 22209 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:57.288677 22210 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:57.288903 22209 leader_election.cc:290] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 2 election: Requested vote from peers f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711), 7f634844362e4093920b23151cc858ac (127.20.32.61:34711)
I20251214 21:01:57.289256 21770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4502aeb6eac54371b2a11b7e25caab1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "7f634844362e4093920b23151cc858ac"
I20251214 21:01:57.289425 21770 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4502aeb6eac54371b2a11b7e25caab1d in current term 2: Already voted for candidate 7f634844362e4093920b23151cc858ac in this term.
I20251214 21:01:57.289523 22210 leader_election.cc:290] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [CANDIDATE]: Term 2 election: Requested vote from peers f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711), 4502aeb6eac54371b2a11b7e25caab1d (127.20.32.60:34193)
I20251214 21:01:57.289672 21837 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f634844362e4093920b23151cc858ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "4502aeb6eac54371b2a11b7e25caab1d"
W20251214 21:01:57.289803 21811 leader_election.cc:336] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711): Network error: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111)
I20251214 21:01:57.289815 21837 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f634844362e4093920b23151cc858ac in current term 2: Already voted for candidate 4502aeb6eac54371b2a11b7e25caab1d in this term.
I20251214 21:01:57.289911 21811 leader_election.cc:304] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4502aeb6eac54371b2a11b7e25caab1d; no voters: 7f634844362e4093920b23151cc858ac, f6b8aa1417fa45158b59f5200ffdeaaf
I20251214 21:01:57.290047 22209 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20251214 21:01:57.290364 21746 leader_election.cc:336] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711): Network error: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111)
I20251214 21:01:57.290423 21746 leader_election.cc:304] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f634844362e4093920b23151cc858ac; no voters: 4502aeb6eac54371b2a11b7e25caab1d, f6b8aa1417fa45158b59f5200ffdeaaf
I20251214 21:01:57.290555 22210 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251214 21:01:59.012753 22222 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:01:59.012907 22222 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:59.013375 22222 leader_election.cc:290] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711), 7f634844362e4093920b23151cc858ac (127.20.32.61:34711)
I20251214 21:01:59.013823 21770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4502aeb6eac54371b2a11b7e25caab1d" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "7f634844362e4093920b23151cc858ac" is_pre_election: true
I20251214 21:01:59.013949 21770 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4502aeb6eac54371b2a11b7e25caab1d in term 2.
W20251214 21:01:59.014060 21811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20251214 21:01:59.014245 21813 leader_election.cc:304] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4502aeb6eac54371b2a11b7e25caab1d, 7f634844362e4093920b23151cc858ac; no voters:
I20251214 21:01:59.014396 22222 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251214 21:01:59.014441 22222 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:01:59.014504 22222 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 2 FOLLOWER]: Advancing to term 3
W20251214 21:01:59.014796 21811 leader_election.cc:336] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711): Network error: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111)
I20251214 21:01:59.015431 22222 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:59.015736 22222 leader_election.cc:290] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 3 election: Requested vote from peers f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711), 7f634844362e4093920b23151cc858ac (127.20.32.61:34711)
I20251214 21:01:59.016031 21770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4502aeb6eac54371b2a11b7e25caab1d" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "7f634844362e4093920b23151cc858ac"
I20251214 21:01:59.016151 21770 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 2 FOLLOWER]: Advancing to term 3
W20251214 21:01:59.016511 21811 leader_election.cc:336] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711): Network error: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111)
I20251214 21:01:59.016933 21770 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4502aeb6eac54371b2a11b7e25caab1d in term 3.
I20251214 21:01:59.017232 21813 leader_election.cc:304] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4502aeb6eac54371b2a11b7e25caab1d, 7f634844362e4093920b23151cc858ac; no voters: f6b8aa1417fa45158b59f5200ffdeaaf
I20251214 21:01:59.017457 22222 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:01:59.017657 22222 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 3 LEADER]: Becoming Leader. State: Replica: 4502aeb6eac54371b2a11b7e25caab1d, State: Running, Role: LEADER
I20251214 21:01:59.017835 22222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } }
I20251214 21:01:59.018509 22225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4502aeb6eac54371b2a11b7e25caab1d. Latest consensus state: current_term: 3 leader_uuid: "4502aeb6eac54371b2a11b7e25caab1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:59.018615 22225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:59.018898 22227 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:01:59.019949 22227 catalog_manager.cc:679] Loaded metadata for table test-workload [id=986a3e08b7e94d1795fdc3da241beddd]
I20251214 21:01:59.020659 22227 tablet_loader.cc:96] loaded metadata for tablet 0fa345f6600a4ed9846bb8c479e7b842 (table test-workload [id=986a3e08b7e94d1795fdc3da241beddd])
I20251214 21:01:59.020844 22227 tablet_loader.cc:96] loaded metadata for tablet b5de42d65d874d8db408573db3b1024f (table test-workload [id=986a3e08b7e94d1795fdc3da241beddd])
I20251214 21:01:59.021008 22227 tablet_loader.cc:96] loaded metadata for tablet e3e20c92484749e9ac8baa82f6f14133 (table test-workload [id=986a3e08b7e94d1795fdc3da241beddd])
I20251214 21:01:59.021104 22227 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:01:59.021482 22227 catalog_manager.cc:1269] Loaded cluster ID: 9f1d5dd0ba8640c3b819309cd85686aa
I20251214 21:01:59.021528 22227 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:01:59.022101 22227 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:01:59.022502 22227 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: Loaded TSK: 0
I20251214 21:01:59.022924 22227 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251214 21:01:59.442595 21811 consensus_peers.cc:597] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d -> Peer f6b8aa1417fa45158b59f5200ffdeaaf (127.20.32.62:45711): Couldn't send request to peer f6b8aa1417fa45158b59f5200ffdeaaf. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.62:45711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:01:59.472158 21770 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 3 FOLLOWER]: Refusing update from remote peer 4502aeb6eac54371b2a11b7e25caab1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 3 index: 10. (index mismatch)
I20251214 21:01:59.472636 22225 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20251214 21:01:59.473645 22228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4502aeb6eac54371b2a11b7e25caab1d. Latest consensus state: current_term: 3 leader_uuid: "4502aeb6eac54371b2a11b7e25caab1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:59.473786 22228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:59.474571 22225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "4502aeb6eac54371b2a11b7e25caab1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:59.474673 22225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:59.474990 22228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "4502aeb6eac54371b2a11b7e25caab1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6b8aa1417fa45158b59f5200ffdeaaf" member_type: VOTER last_known_addr { host: "127.20.32.62" port: 45711 } } peers { permanent_uuid: "7f634844362e4093920b23151cc858ac" member_type: VOTER last_known_addr { host: "127.20.32.61" port: 34711 } } peers { permanent_uuid: "4502aeb6eac54371b2a11b7e25caab1d" member_type: VOTER last_known_addr { host: "127.20.32.60" port: 34193 } } }
I20251214 21:01:59.475092 22228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [sys.catalog]: This master's current role is: FOLLOWER
I20251214 21:01:59.497646 21891 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:01:59.497792 21891 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:01:59.633273 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:01:59.636621 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:59.636828 20608 tablet_replica.cc:333] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f: stopping tablet replica
I20251214 21:01:59.636938 20608 raft_consensus.cc:2243] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:59.637069 20608 raft_consensus.cc:2272] T e3e20c92484749e9ac8baa82f6f14133 P 8a8a20bc870c4937aa7c196684a9853f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:59.649583 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:01:59.651577 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:01:59.654810 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:59.655009 20608 tablet_replica.cc:333] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb: stopping tablet replica
I20251214 21:01:59.655119 20608 raft_consensus.cc:2243] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:59.655237 20608 raft_consensus.cc:2272] T b5de42d65d874d8db408573db3b1024f P 4f6a151bbc7e4eee8df8fb8250faaabb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:59.667537 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:01:59.669417 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:01:59.672700 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:01:59.672880 20608 tablet_replica.cc:333] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29: stopping tablet replica
I20251214 21:01:59.672986 20608 raft_consensus.cc:2243] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:01:59.673089 20608 raft_consensus.cc:2272] T 0fa345f6600a4ed9846bb8c479e7b842 P bc3f96d8a34f4e18aebe7501ed434e29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:59.685259 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:01:59.687116 20608 master.cc:561] Master@127.20.32.61:34711 shutting down...
I20251214 21:01:59.690395 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:01:59.690541 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:59.690608 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7f634844362e4093920b23151cc858ac: stopping tablet replica
I20251214 21:01:59.703145 20608 master.cc:583] Master@127.20.32.61:34711 shutdown complete.
I20251214 21:01:59.705461 20608 master.cc:561] Master@127.20.32.60:34193 shutting down...
I20251214 21:01:59.708616 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 3 LEADER]: Raft consensus shutting down.
I20251214 21:01:59.708838 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:01:59.708961 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4502aeb6eac54371b2a11b7e25caab1d: stopping tablet replica
I20251214 21:01:59.711280 20608 master.cc:583] Master@127.20.32.60:34193 shutdown complete.
[ OK ] AutoRebalancerTest.NextLeaderResumesAutoRebalancing (6352 ms)
[ RUN ] AutoRebalancerTest.MovesScheduledIfAddTserver
I20251214 21:01:59.717344 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:43449
I20251214 21:01:59.717639 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:01:59.719261 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:59.719326 22235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:59.719699 22233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:59.719713 22232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:59.719956 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:59.720002 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:59.720016 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746119720016 us; error 0 us; skew 500 ppm
I20251214 21:01:59.720759 20608 webserver.cc:492] Webserver started at http://127.20.32.62:37011/ using document root <none> and password file <none>
I20251214 21:01:59.720886 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:59.720929 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:59.721011 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:59.721411 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "11e4142a1092427cbe539f228fd0315c"
format_stamp: "Formatted at 2025-12-14 21:01:59 on dist-test-slave-bphs"
I20251214 21:01:59.722743 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:59.723600 22240 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.723829 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:59.723886 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "11e4142a1092427cbe539f228fd0315c"
format_stamp: "Formatted at 2025-12-14 21:01:59 on dist-test-slave-bphs"
I20251214 21:01:59.723937 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:59.745067 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:59.745419 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:59.749096 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:43449
I20251214 21:01:59.751991 22292 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:43449 every 8 connection(s)
I20251214 21:01:59.752462 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:01:59.754215 22293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c: Bootstrap starting.
I20251214 21:01:59.754920 22293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c: Neither blocks nor log segments found. Creating new log.
I20251214 21:01:59.755767 22293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c: No bootstrap required, opened a new log
I20251214 21:01:59.756096 22293 raft_consensus.cc:359] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4142a1092427cbe539f228fd0315c" member_type: VOTER }
I20251214 21:01:59.756175 22293 raft_consensus.cc:385] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:01:59.756201 22293 raft_consensus.cc:740] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11e4142a1092427cbe539f228fd0315c, State: Initialized, Role: FOLLOWER
I20251214 21:01:59.756314 22293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4142a1092427cbe539f228fd0315c" member_type: VOTER }
I20251214 21:01:59.756387 22293 raft_consensus.cc:399] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:01:59.756415 22293 raft_consensus.cc:493] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:01:59.756448 22293 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:01:59.757051 22293 raft_consensus.cc:515] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4142a1092427cbe539f228fd0315c" member_type: VOTER }
I20251214 21:01:59.757155 22293 leader_election.cc:304] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11e4142a1092427cbe539f228fd0315c; no voters:
I20251214 21:01:59.757297 22293 leader_election.cc:290] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:01:59.757381 22296 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:01:59.757576 22296 raft_consensus.cc:697] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 1 LEADER]: Becoming Leader. State: Replica: 11e4142a1092427cbe539f228fd0315c, State: Running, Role: LEADER
I20251214 21:01:59.757689 22293 sys_catalog.cc:565] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:01:59.757725 22296 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4142a1092427cbe539f228fd0315c" member_type: VOTER }
I20251214 21:01:59.758132 22297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11e4142a1092427cbe539f228fd0315c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4142a1092427cbe539f228fd0315c" member_type: VOTER } }
I20251214 21:01:59.758165 22298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11e4142a1092427cbe539f228fd0315c. Latest consensus state: current_term: 1 leader_uuid: "11e4142a1092427cbe539f228fd0315c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4142a1092427cbe539f228fd0315c" member_type: VOTER } }
I20251214 21:01:59.758294 22298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:59.758280 22297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [sys.catalog]: This master's current role is: LEADER
I20251214 21:01:59.758833 22302 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:01:59.759546 22302 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:01:59.759699 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:01:59.761271 22302 catalog_manager.cc:1357] Generated new cluster ID: 9a031a69303f407d964b01aeab5c01d0
I20251214 21:01:59.761317 22302 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:01:59.776466 22302 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:01:59.777002 22302 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:01:59.782030 22302 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c: Generated new TSK 0
I20251214 21:01:59.782177 22302 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:01:59.791900 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:59.793675 22314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:59.793824 22315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:59.793848 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:59.793969 22317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:59.794166 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:59.794207 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:59.794222 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746119794222 us; error 0 us; skew 500 ppm
I20251214 21:01:59.794935 20608 webserver.cc:492] Webserver started at http://127.20.32.1:36413/ using document root <none> and password file <none>
I20251214 21:01:59.795055 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:59.795096 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:59.795142 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:59.795496 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "cf2394c8d8374d9e9be37bd774b9e90d"
format_stamp: "Formatted at 2025-12-14 21:01:59 on dist-test-slave-bphs"
I20251214 21:01:59.796770 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:59.797557 22322 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.797830 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:59.797889 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "cf2394c8d8374d9e9be37bd774b9e90d"
format_stamp: "Formatted at 2025-12-14 21:01:59 on dist-test-slave-bphs"
I20251214 21:01:59.797957 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:59.823762 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:59.824193 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:59.824466 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:59.824930 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:59.824970 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.825021 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:59.825048 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.828789 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:36175
I20251214 21:01:59.828831 22385 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:36175 every 8 connection(s)
I20251214 21:01:59.829514 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:59.831329 22390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:59.831521 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:59.831375 22391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:59.831418 22393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:59.831854 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:59.831905 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:59.831934 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746119831934 us; error 0 us; skew 500 ppm
I20251214 21:01:59.832808 20608 webserver.cc:492] Webserver started at http://127.20.32.2:35133/ using document root <none> and password file <none>
I20251214 21:01:59.832937 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:59.832973 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:59.833041 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:59.833372 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "90bb01ceca484ba0aca3e8f3229d4f72"
format_stamp: "Formatted at 2025-12-14 21:01:59 on dist-test-slave-bphs"
I20251214 21:01:59.834686 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:01:59.835480 22398 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.835718 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:01:59.835778 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "90bb01ceca484ba0aca3e8f3229d4f72"
format_stamp: "Formatted at 2025-12-14 21:01:59 on dist-test-slave-bphs"
I20251214 21:01:59.835845 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:59.836817 22386 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43449
I20251214 21:01:59.836905 22386 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:59.837131 22386 heartbeater.cc:507] Master 127.20.32.62:43449 requested a full tablet report, sending...
I20251214 21:01:59.837673 22257 ts_manager.cc:194] Registered new tserver with Master: cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1:36175)
I20251214 21:01:59.838424 22257 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51620
I20251214 21:01:59.866567 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:59.866976 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:59.867259 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:59.867755 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:59.867794 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.867826 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:59.867853 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.871810 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:45423
I20251214 21:01:59.871846 22461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:45423 every 8 connection(s)
I20251214 21:01:59.872574 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:01:59.874493 22465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:01:59.874593 22466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:59.874631 20608 server_base.cc:1047] running on GCE node
W20251214 21:01:59.875367 22468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:01:59.875574 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:01:59.875625 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:01:59.875645 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746119875644 us; error 0 us; skew 500 ppm
I20251214 21:01:59.876492 22462 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43449
I20251214 21:01:59.876542 20608 webserver.cc:492] Webserver started at http://127.20.32.3:37357/ using document root <none> and password file <none>
I20251214 21:01:59.876588 22462 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:59.876682 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:01:59.876729 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:01:59.876798 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:01:59.876807 22462 heartbeater.cc:507] Master 127.20.32.62:43449 requested a full tablet report, sending...
I20251214 21:01:59.877187 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "5a2abb3a200543f7a9b13b9bc1728c53"
format_stamp: "Formatted at 2025-12-14 21:01:59 on dist-test-slave-bphs"
I20251214 21:01:59.877353 22257 ts_manager.cc:194] Registered new tserver with Master: 90bb01ceca484ba0aca3e8f3229d4f72 (127.20.32.2:45423)
I20251214 21:01:59.877883 22257 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51632
I20251214 21:01:59.878665 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:01:59.879501 22473 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.879741 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:01:59.879799 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "5a2abb3a200543f7a9b13b9bc1728c53"
format_stamp: "Formatted at 2025-12-14 21:01:59 on dist-test-slave-bphs"
I20251214 21:01:59.879853 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:01:59.887208 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:01:59.887563 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:01:59.887820 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:01:59.888266 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:01:59.888311 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.888340 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:01:59.888355 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:01:59.892577 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:35421
I20251214 21:01:59.892635 22536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:35421 every 8 connection(s)
I20251214 21:01:59.897043 22537 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43449
I20251214 21:01:59.897142 22537 heartbeater.cc:461] Registering TS with master...
I20251214 21:01:59.897342 22537 heartbeater.cc:507] Master 127.20.32.62:43449 requested a full tablet report, sending...
I20251214 21:01:59.897949 22257 ts_manager.cc:194] Registered new tserver with Master: 5a2abb3a200543f7a9b13b9bc1728c53 (127.20.32.3:35421)
I20251214 21:01:59.898478 22257 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51636
I20251214 21:01:59.898558 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005583789s
I20251214 21:02:00.839341 22386 heartbeater.cc:499] Master 127.20.32.62:43449 was elected leader, sending a full tablet report...
I20251214 21:02:00.878721 22462 heartbeater.cc:499] Master 127.20.32.62:43449 was elected leader, sending a full tablet report...
I20251214 21:02:00.899401 22537 heartbeater.cc:499] Master 127.20.32.62:43449 was elected leader, sending a full tablet report...
I20251214 21:02:00.924901 20608 test_util.cc:276] Using random seed: -833806624
I20251214 21:02:00.932937 22257 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51646:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:02:00.933406 22257 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:02:00.942967 22349 tablet_service.cc:1505] Processing CreateTablet for tablet be1d317bbf4e4128acc5d7c4053f5d63 (DEFAULT_TABLE table=test-workload [id=545c5cb4f93145f8821244e92c4c3774]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20251214 21:02:00.942915 22350 tablet_service.cc:1505] Processing CreateTablet for tablet 94945923e2ba4a28bad25d79c04130a2 (DEFAULT_TABLE table=test-workload [id=545c5cb4f93145f8821244e92c4c3774]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20251214 21:02:00.943336 22349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1d317bbf4e4128acc5d7c4053f5d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:00.943492 22350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94945923e2ba4a28bad25d79c04130a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:00.943894 22426 tablet_service.cc:1505] Processing CreateTablet for tablet 94945923e2ba4a28bad25d79c04130a2 (DEFAULT_TABLE table=test-workload [id=545c5cb4f93145f8821244e92c4c3774]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20251214 21:02:00.943958 22425 tablet_service.cc:1505] Processing CreateTablet for tablet be1d317bbf4e4128acc5d7c4053f5d63 (DEFAULT_TABLE table=test-workload [id=545c5cb4f93145f8821244e92c4c3774]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20251214 21:02:00.944129 22426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94945923e2ba4a28bad25d79c04130a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:00.944310 22425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1d317bbf4e4128acc5d7c4053f5d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:00.946038 22501 tablet_service.cc:1505] Processing CreateTablet for tablet 94945923e2ba4a28bad25d79c04130a2 (DEFAULT_TABLE table=test-workload [id=545c5cb4f93145f8821244e92c4c3774]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20251214 21:02:00.946293 22501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94945923e2ba4a28bad25d79c04130a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:00.946952 22557 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: Bootstrap starting.
I20251214 21:02:00.946941 22500 tablet_service.cc:1505] Processing CreateTablet for tablet be1d317bbf4e4128acc5d7c4053f5d63 (DEFAULT_TABLE table=test-workload [id=545c5cb4f93145f8821244e92c4c3774]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20251214 21:02:00.947240 22500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1d317bbf4e4128acc5d7c4053f5d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:00.948371 22559 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53: Bootstrap starting.
I20251214 21:02:00.949425 22557 tablet_bootstrap.cc:654] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:00.949425 22559 tablet_bootstrap.cc:654] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:00.949844 22558 tablet_bootstrap.cc:492] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72: Bootstrap starting.
I20251214 21:02:00.950675 22558 tablet_bootstrap.cc:654] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:00.950707 22557 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: No bootstrap required, opened a new log
I20251214 21:02:00.950788 22557 ts_tablet_manager.cc:1403] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:02:00.951187 22557 raft_consensus.cc:359] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.951289 22557 raft_consensus.cc:385] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:00.951320 22557 raft_consensus.cc:740] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2394c8d8374d9e9be37bd774b9e90d, State: Initialized, Role: FOLLOWER
I20251214 21:02:00.951444 22557 consensus_queue.cc:260] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.951606 22558 tablet_bootstrap.cc:492] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72: No bootstrap required, opened a new log
I20251214 21:02:00.951692 22558 ts_tablet_manager.cc:1403] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:02:00.951766 22557 ts_tablet_manager.cc:1434] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:00.951912 22557 tablet_bootstrap.cc:492] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d: Bootstrap starting.
I20251214 21:02:00.952026 22558 raft_consensus.cc:359] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.952163 22558 raft_consensus.cc:385] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:00.952232 22558 raft_consensus.cc:740] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90bb01ceca484ba0aca3e8f3229d4f72, State: Initialized, Role: FOLLOWER
I20251214 21:02:00.952387 22558 consensus_queue.cc:260] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.952703 22558 ts_tablet_manager.cc:1434] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:00.952857 22558 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72: Bootstrap starting.
I20251214 21:02:00.953146 22557 tablet_bootstrap.cc:654] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:00.954056 22559 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53: No bootstrap required, opened a new log
I20251214 21:02:00.954180 22559 ts_tablet_manager.cc:1403] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251214 21:02:00.954493 22558 tablet_bootstrap.cc:654] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:00.954627 22559 raft_consensus.cc:359] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.954739 22559 raft_consensus.cc:385] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:00.954816 22559 raft_consensus.cc:740] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2abb3a200543f7a9b13b9bc1728c53, State: Initialized, Role: FOLLOWER
I20251214 21:02:00.954953 22559 consensus_queue.cc:260] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.955291 22559 ts_tablet_manager.cc:1434] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:00.955456 22559 tablet_bootstrap.cc:492] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53: Bootstrap starting.
I20251214 21:02:00.955776 22558 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72: No bootstrap required, opened a new log
I20251214 21:02:00.955855 22558 ts_tablet_manager.cc:1403] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:02:00.956202 22558 raft_consensus.cc:359] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.956350 22558 raft_consensus.cc:385] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:00.956369 22559 tablet_bootstrap.cc:654] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:00.956393 22558 raft_consensus.cc:740] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90bb01ceca484ba0aca3e8f3229d4f72, State: Initialized, Role: FOLLOWER
I20251214 21:02:00.956506 22558 consensus_queue.cc:260] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.956727 22558 ts_tablet_manager.cc:1434] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:00.957360 22557 tablet_bootstrap.cc:492] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d: No bootstrap required, opened a new log
I20251214 21:02:00.957448 22559 tablet_bootstrap.cc:492] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53: No bootstrap required, opened a new log
I20251214 21:02:00.957438 22557 ts_tablet_manager.cc:1403] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251214 21:02:00.957547 22559 ts_tablet_manager.cc:1403] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:02:00.957969 22559 raft_consensus.cc:359] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.958050 22559 raft_consensus.cc:385] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:00.958091 22559 raft_consensus.cc:740] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2abb3a200543f7a9b13b9bc1728c53, State: Initialized, Role: FOLLOWER
I20251214 21:02:00.958065 22557 raft_consensus.cc:359] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.958175 22557 raft_consensus.cc:385] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:00.958220 22557 raft_consensus.cc:740] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2394c8d8374d9e9be37bd774b9e90d, State: Initialized, Role: FOLLOWER
I20251214 21:02:00.958201 22559 consensus_queue.cc:260] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.958364 22557 consensus_queue.cc:260] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:00.958442 22559 ts_tablet_manager.cc:1434] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:00.958622 22557 ts_tablet_manager.cc:1434] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:01.274812 22567 raft_consensus.cc:493] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:02:01.274976 22567 raft_consensus.cc:515] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:01.275511 22567 leader_election.cc:290] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1:36175), 90bb01ceca484ba0aca3e8f3229d4f72 (127.20.32.2:45423)
I20251214 21:02:01.278941 22360 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be1d317bbf4e4128acc5d7c4053f5d63" candidate_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" is_pre_election: true
I20251214 21:02:01.279012 22436 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be1d317bbf4e4128acc5d7c4053f5d63" candidate_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" is_pre_election: true
I20251214 21:02:01.279088 22360 raft_consensus.cc:2468] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2abb3a200543f7a9b13b9bc1728c53 in term 0.
I20251214 21:02:01.279124 22436 raft_consensus.cc:2468] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2abb3a200543f7a9b13b9bc1728c53 in term 0.
I20251214 21:02:01.279388 22475 leader_election.cc:304] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2abb3a200543f7a9b13b9bc1728c53, cf2394c8d8374d9e9be37bd774b9e90d; no voters:
I20251214 21:02:01.279543 22567 raft_consensus.cc:2804] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:02:01.279603 22567 raft_consensus.cc:493] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:02:01.279649 22567 raft_consensus.cc:3060] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:01.280476 22567 raft_consensus.cc:515] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:01.280853 22567 leader_election.cc:290] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [CANDIDATE]: Term 1 election: Requested vote from peers cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1:36175), 90bb01ceca484ba0aca3e8f3229d4f72 (127.20.32.2:45423)
I20251214 21:02:01.281104 22360 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be1d317bbf4e4128acc5d7c4053f5d63" candidate_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2394c8d8374d9e9be37bd774b9e90d"
I20251214 21:02:01.281157 22436 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be1d317bbf4e4128acc5d7c4053f5d63" candidate_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90bb01ceca484ba0aca3e8f3229d4f72"
I20251214 21:02:01.281208 22360 raft_consensus.cc:3060] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:01.281234 22436 raft_consensus.cc:3060] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:01.282073 22436 raft_consensus.cc:2468] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2abb3a200543f7a9b13b9bc1728c53 in term 1.
I20251214 21:02:01.282150 22360 raft_consensus.cc:2468] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2abb3a200543f7a9b13b9bc1728c53 in term 1.
I20251214 21:02:01.282312 22477 leader_election.cc:304] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2abb3a200543f7a9b13b9bc1728c53, 90bb01ceca484ba0aca3e8f3229d4f72; no voters:
I20251214 21:02:01.282506 22567 raft_consensus.cc:2804] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:02:01.282649 22564 raft_consensus.cc:493] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:02:01.282699 22567 raft_consensus.cc:697] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 LEADER]: Becoming Leader. State: Replica: 5a2abb3a200543f7a9b13b9bc1728c53, State: Running, Role: LEADER
I20251214 21:02:01.282735 22564 raft_consensus.cc:515] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:01.282837 22567 consensus_queue.cc:237] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:01.283142 22564 leader_election.cc:290] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1:36175), 5a2abb3a200543f7a9b13b9bc1728c53 (127.20.32.3:35421)
I20251214 21:02:01.284420 22257 catalog_manager.cc:5654] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2abb3a200543f7a9b13b9bc1728c53 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } health_report { overall_health: HEALTHY } } }
I20251214 21:02:01.287154 22360 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94945923e2ba4a28bad25d79c04130a2" candidate_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" is_pre_election: true
I20251214 21:02:01.287241 22511 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94945923e2ba4a28bad25d79c04130a2" candidate_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" is_pre_election: true
I20251214 21:02:01.287277 22360 raft_consensus.cc:2468] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90bb01ceca484ba0aca3e8f3229d4f72 in term 0.
I20251214 21:02:01.287354 22511 raft_consensus.cc:2468] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90bb01ceca484ba0aca3e8f3229d4f72 in term 0.
I20251214 21:02:01.287523 22400 leader_election.cc:304] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90bb01ceca484ba0aca3e8f3229d4f72, cf2394c8d8374d9e9be37bd774b9e90d; no voters:
I20251214 21:02:01.287671 22564 raft_consensus.cc:2804] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:02:01.287729 22564 raft_consensus.cc:493] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:02:01.287765 22564 raft_consensus.cc:3060] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:01.288519 22564 raft_consensus.cc:515] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:01.288815 22564 leader_election.cc:290] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [CANDIDATE]: Term 1 election: Requested vote from peers cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1:36175), 5a2abb3a200543f7a9b13b9bc1728c53 (127.20.32.3:35421)
I20251214 21:02:01.289088 22360 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94945923e2ba4a28bad25d79c04130a2" candidate_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2394c8d8374d9e9be37bd774b9e90d"
I20251214 21:02:01.289088 22511 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "94945923e2ba4a28bad25d79c04130a2" candidate_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2abb3a200543f7a9b13b9bc1728c53"
I20251214 21:02:01.289196 22511 raft_consensus.cc:3060] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:01.289184 22360 raft_consensus.cc:3060] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:01.289940 22360 raft_consensus.cc:2468] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90bb01ceca484ba0aca3e8f3229d4f72 in term 1.
I20251214 21:02:01.289958 22511 raft_consensus.cc:2468] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90bb01ceca484ba0aca3e8f3229d4f72 in term 1.
I20251214 21:02:01.290192 22401 leader_election.cc:304] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2abb3a200543f7a9b13b9bc1728c53, 90bb01ceca484ba0aca3e8f3229d4f72; no voters:
I20251214 21:02:01.290337 22564 raft_consensus.cc:2804] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:02:01.290521 22564 raft_consensus.cc:697] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 LEADER]: Becoming Leader. State: Replica: 90bb01ceca484ba0aca3e8f3229d4f72, State: Running, Role: LEADER
I20251214 21:02:01.290643 22564 consensus_queue.cc:237] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } }
I20251214 21:02:01.291900 22257 catalog_manager.cc:5654] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90bb01ceca484ba0aca3e8f3229d4f72 (127.20.32.2). New cstate: current_term: 1 leader_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } health_report { overall_health: UNKNOWN } } }
I20251214 21:02:01.718583 22567 consensus_queue.cc:1048] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:02:01.721570 22580 consensus_queue.cc:1048] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:02:01.753446 22564 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:02:01.756053 22575 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:02:01.759665 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:01.759987 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:01.760056 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:03.760295 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:03.760658 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:03.760751 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:05.760999 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:05.761346 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:05.761401 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:07.761746 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:07.762147 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:07.762208 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:09.762498 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:09.762866 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:09.762920 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:11.763284 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:11.763688 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:11.763747 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:12.355530 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:12.357638 22593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:12.357764 22590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:12.357844 22591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:12.357779 20608 server_base.cc:1047] running on GCE node
I20251214 21:02:12.358047 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:12.358088 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:12.358103 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746132358102 us; error 0 us; skew 500 ppm
I20251214 21:02:12.359047 20608 webserver.cc:492] Webserver started at http://127.20.32.4:38953/ using document root <none> and password file <none>
I20251214 21:02:12.359192 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:12.359261 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:12.359329 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:12.359691 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-3-root/instance:
uuid: "7d24c54c8f844292b0eb52e8e477a1dd"
format_stamp: "Formatted at 2025-12-14 21:02:12 on dist-test-slave-bphs"
I20251214 21:02:12.361080 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:02:12.362003 22598 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:12.362294 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:12.362365 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-3-root
uuid: "7d24c54c8f844292b0eb52e8e477a1dd"
format_stamp: "Formatted at 2025-12-14 21:02:12 on dist-test-slave-bphs"
I20251214 21:02:12.362439 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:12.378413 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:12.378840 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:12.379148 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:02:12.379616 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:02:12.379657 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:12.379699 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:02:12.379734 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:12.384344 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.4:43661
I20251214 21:02:12.384382 22661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.4:43661 every 8 connection(s)
I20251214 21:02:12.392170 22662 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43449
I20251214 21:02:12.392297 22662 heartbeater.cc:461] Registering TS with master...
I20251214 21:02:12.392544 22662 heartbeater.cc:507] Master 127.20.32.62:43449 requested a full tablet report, sending...
I20251214 21:02:12.393164 22256 ts_manager.cc:194] Registered new tserver with Master: 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4:43661)
I20251214 21:02:12.393762 22256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42954
I20251214 21:02:12.774644 22436 consensus_queue.cc:237] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: true } }
I20251214 21:02:12.776078 22360 raft_consensus.cc:1275] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Refusing update from remote peer 90bb01ceca484ba0aca3e8f3229d4f72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:02:12.776304 22511 raft_consensus.cc:1275] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Refusing update from remote peer 90bb01ceca484ba0aca3e8f3229d4f72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:02:12.776424 22669 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:02:12.776695 22589 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:02:12.778065 22669 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: true } } }
I20251214 21:02:12.778537 22511 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: true } } }
I20251214 21:02:12.778604 22360 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: true } } }
I20251214 21:02:12.780992 22256 catalog_manager.cc:5654] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 reported cstate change: config changed from index -1 to 2, NON_VOTER 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: true } } }
W20251214 21:02:12.781297 22401 consensus_peers.cc:597] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 -> Peer 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4:43661): Couldn't send request to peer 7d24c54c8f844292b0eb52e8e477a1dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94945923e2ba4a28bad25d79c04130a2. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:02:13.315764 22681 ts_tablet_manager.cc:933] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: Initiating tablet copy from peer 90bb01ceca484ba0aca3e8f3229d4f72 (127.20.32.2:45423)
I20251214 21:02:13.316078 22681 tablet_copy_client.cc:323] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:45423
I20251214 21:02:13.319592 22446 tablet_copy_service.cc:140] P 90bb01ceca484ba0aca3e8f3229d4f72: Received BeginTabletCopySession request for tablet 94945923e2ba4a28bad25d79c04130a2 from peer 7d24c54c8f844292b0eb52e8e477a1dd ({username='slave'} at 127.0.0.1:60866)
I20251214 21:02:13.319693 22446 tablet_copy_service.cc:161] P 90bb01ceca484ba0aca3e8f3229d4f72: Beginning new tablet copy session on tablet 94945923e2ba4a28bad25d79c04130a2 from peer 7d24c54c8f844292b0eb52e8e477a1dd at {username='slave'} at 127.0.0.1:60866: session id = 7d24c54c8f844292b0eb52e8e477a1dd-94945923e2ba4a28bad25d79c04130a2
I20251214 21:02:13.320420 22446 tablet_copy_source_session.cc:215] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:02:13.321200 22681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94945923e2ba4a28bad25d79c04130a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:13.323221 22681 tablet_copy_client.cc:806] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: tablet copy: Starting download of 0 data blocks...
I20251214 21:02:13.323374 22681 tablet_copy_client.cc:670] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: tablet copy: Starting download of 1 WAL segments...
I20251214 21:02:13.324266 22681 tablet_copy_client.cc:538] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:02:13.325524 22681 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: Bootstrap starting.
I20251214 21:02:13.328943 22681 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:02:13.329157 22681 tablet_bootstrap.cc:492] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: Bootstrap complete.
I20251214 21:02:13.329311 22681 ts_tablet_manager.cc:1403] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20251214 21:02:13.329854 22681 raft_consensus.cc:359] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: true } }
I20251214 21:02:13.329967 22681 raft_consensus.cc:740] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7d24c54c8f844292b0eb52e8e477a1dd, State: Initialized, Role: LEARNER
I20251214 21:02:13.330053 22681 consensus_queue.cc:260] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: true } }
I20251214 21:02:13.330399 22681 ts_tablet_manager.cc:1434] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:02:13.330428 22662 heartbeater.cc:499] Master 127.20.32.62:43449 was elected leader, sending a full tablet report...
I20251214 21:02:13.330791 22446 tablet_copy_service.cc:342] P 90bb01ceca484ba0aca3e8f3229d4f72: Request end of tablet copy session 7d24c54c8f844292b0eb52e8e477a1dd-94945923e2ba4a28bad25d79c04130a2 received from {username='slave'} at 127.0.0.1:60866
I20251214 21:02:13.330869 22446 tablet_copy_service.cc:434] P 90bb01ceca484ba0aca3e8f3229d4f72: ending tablet copy session 7d24c54c8f844292b0eb52e8e477a1dd-94945923e2ba4a28bad25d79c04130a2 on tablet 94945923e2ba4a28bad25d79c04130a2 with peer 7d24c54c8f844292b0eb52e8e477a1dd
I20251214 21:02:13.763978 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:13.764345 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:13.764418 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:13.891162 22636 raft_consensus.cc:1217] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251214 21:02:14.326454 22687 raft_consensus.cc:1064] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72: attempting to promote NON_VOTER 7d24c54c8f844292b0eb52e8e477a1dd to VOTER
I20251214 21:02:14.326946 22687 consensus_queue.cc:237] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } }
I20251214 21:02:14.328174 22636 raft_consensus.cc:1275] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 LEARNER]: Refusing update from remote peer 90bb01ceca484ba0aca3e8f3229d4f72: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:02:14.328251 22511 raft_consensus.cc:1275] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Refusing update from remote peer 90bb01ceca484ba0aca3e8f3229d4f72: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:02:14.328569 22360 raft_consensus.cc:1275] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Refusing update from remote peer 90bb01ceca484ba0aca3e8f3229d4f72: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:02:14.328634 22690 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:02:14.328811 22687 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:02:14.329952 22690 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:02:14.331207 22687 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } } }
I20251214 21:02:14.331604 22511 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } } }
I20251214 21:02:14.333071 22360 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } } }
I20251214 21:02:14.333746 22256 catalog_manager.cc:5654] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 reported cstate change: config changed from index 2 to 3, 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:02:14.334664 22636 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7d24c54c8f844292b0eb52e8e477a1dd (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cf2394c8d8374d9e9be37bd774b9e90d" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 36175 } attrs { replace: true } } peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } } }
I20251214 21:02:14.338285 22435 consensus_queue.cc:237] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } }
I20251214 21:02:14.339645 22636 raft_consensus.cc:1275] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 FOLLOWER]: Refusing update from remote peer 90bb01ceca484ba0aca3e8f3229d4f72: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251214 21:02:14.339798 22511 raft_consensus.cc:1275] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Refusing update from remote peer 90bb01ceca484ba0aca3e8f3229d4f72: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251214 21:02:14.340039 22691 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:02:14.340252 22680 consensus_queue.cc:1048] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:02:14.341742 22690 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } } }
I20251214 21:02:14.342028 22511 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } } }
I20251214 21:02:14.342088 22636 raft_consensus.cc:2955] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } } }
I20251214 21:02:14.343334 22244 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 94945923e2ba4a28bad25d79c04130a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:02:14.344398 22255 catalog_manager.cc:5654] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd reported cstate change: config changed from index 3 to 4, VOTER cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1) evicted. New cstate: current_term: 1 leader_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "90bb01ceca484ba0aca3e8f3229d4f72" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45423 } } peers { permanent_uuid: "5a2abb3a200543f7a9b13b9bc1728c53" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 35421 } } peers { permanent_uuid: "7d24c54c8f844292b0eb52e8e477a1dd" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43661 } attrs { promote: false } } }
I20251214 21:02:14.346721 22349 tablet_service.cc:1552] Processing DeleteTablet for tablet 94945923e2ba4a28bad25d79c04130a2 with delete_type TABLET_DATA_TOMBSTONED (TS cf2394c8d8374d9e9be37bd774b9e90d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20251214 21:02:14.347333 22700 tablet_replica.cc:333] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: stopping tablet replica
I20251214 21:02:14.347465 22700 raft_consensus.cc:2243] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:02:14.347628 22700 raft_consensus.cc:2272] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:14.348210 22700 ts_tablet_manager.cc:1916] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:02:14.350131 22700 ts_tablet_manager.cc:1929] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251214 21:02:14.350208 22700 log.cc:1199] T 94945923e2ba4a28bad25d79c04130a2 P cf2394c8d8374d9e9be37bd774b9e90d: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.MovesScheduledIfAddTserver.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/94945923e2ba4a28bad25d79c04130a2
I20251214 21:02:14.350665 22242 catalog_manager.cc:4985] TS cf2394c8d8374d9e9be37bd774b9e90d (127.20.32.1:36175): tablet 94945923e2ba4a28bad25d79c04130a2 (table test-workload [id=545c5cb4f93145f8821244e92c4c3774]) successfully deleted
I20251214 21:02:15.764766 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:15.765139 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:15.765197 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:17.765515 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:17.765925 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:17.765988 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:19.766330 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:19.766695 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:19.766752 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:21.767088 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:21.767462 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:21.767518 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:23.767827 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:23.768196 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:23.768249 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:25.768566 22311 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:25.768918 22311 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:25.768970 22311 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:26.462268 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:02:26.465822 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:02:26.466029 20608 tablet_replica.cc:333] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d: stopping tablet replica
I20251214 21:02:26.466145 20608 raft_consensus.cc:2243] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:02:26.466262 20608 raft_consensus.cc:2272] T be1d317bbf4e4128acc5d7c4053f5d63 P cf2394c8d8374d9e9be37bd774b9e90d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:26.480113 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:02:26.482276 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:02:26.486004 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:02:26.486196 20608 tablet_replica.cc:333] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72: stopping tablet replica
I20251214 21:02:26.486330 20608 raft_consensus.cc:2243] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:02:26.486526 20608 raft_consensus.cc:2272] T 94945923e2ba4a28bad25d79c04130a2 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:26.486943 20608 tablet_replica.cc:333] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72: stopping tablet replica
I20251214 21:02:26.487027 20608 raft_consensus.cc:2243] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:02:26.487116 20608 raft_consensus.cc:2272] T be1d317bbf4e4128acc5d7c4053f5d63 P 90bb01ceca484ba0aca3e8f3229d4f72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:26.499852 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:02:26.502091 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:02:26.505447 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:02:26.505846 20608 tablet_replica.cc:333] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53: stopping tablet replica
I20251214 21:02:26.505962 20608 raft_consensus.cc:2243] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:02:26.506163 20608 raft_consensus.cc:2272] T be1d317bbf4e4128acc5d7c4053f5d63 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:26.506670 20608 tablet_replica.cc:333] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53: stopping tablet replica
I20251214 21:02:26.506768 20608 raft_consensus.cc:2243] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:02:26.506875 20608 raft_consensus.cc:2272] T 94945923e2ba4a28bad25d79c04130a2 P 5a2abb3a200543f7a9b13b9bc1728c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:26.519471 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:02:26.521597 20608 tablet_server.cc:178] TabletServer@127.20.32.4:0 shutting down...
I20251214 21:02:26.524682 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:02:26.524866 20608 tablet_replica.cc:333] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd: stopping tablet replica
I20251214 21:02:26.524992 20608 raft_consensus.cc:2243] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:02:26.525127 20608 raft_consensus.cc:2272] T 94945923e2ba4a28bad25d79c04130a2 P 7d24c54c8f844292b0eb52e8e477a1dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:26.537635 20608 tablet_server.cc:195] TabletServer@127.20.32.4:0 shutdown complete.
I20251214 21:02:26.539577 20608 master.cc:561] Master@127.20.32.62:43449 shutting down...
I20251214 21:02:26.543161 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:02:26.543326 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:26.543391 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 11e4142a1092427cbe539f228fd0315c: stopping tablet replica
I20251214 21:02:26.556018 20608 master.cc:583] Master@127.20.32.62:43449 shutdown complete.
[ OK ] AutoRebalancerTest.MovesScheduledIfAddTserver (26845 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfNoTservers
I20251214 21:02:26.563225 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:42037
I20251214 21:02:26.563578 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:26.565279 22702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:26.565341 22703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:26.565418 20608 server_base.cc:1047] running on GCE node
W20251214 21:02:26.565532 22705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:26.565759 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:26.565817 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:26.565838 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746146565837 us; error 0 us; skew 500 ppm
I20251214 21:02:26.566664 20608 webserver.cc:492] Webserver started at http://127.20.32.62:44787/ using document root <none> and password file <none>
I20251214 21:02:26.566803 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:26.566851 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:26.566926 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:26.567319 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "ec60a874bd584849a68f45cb29f4591c"
format_stamp: "Formatted at 2025-12-14 21:02:26 on dist-test-slave-bphs"
I20251214 21:02:26.568876 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:02:26.570056 22710 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:26.570329 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:02:26.570402 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "ec60a874bd584849a68f45cb29f4591c"
format_stamp: "Formatted at 2025-12-14 21:02:26 on dist-test-slave-bphs"
I20251214 21:02:26.570477 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTservers.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:26.579429 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:26.579802 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:26.583761 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:42037
I20251214 21:02:26.586567 22762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:42037 every 8 connection(s)
I20251214 21:02:26.587075 22763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:26.588814 22763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c: Bootstrap starting.
I20251214 21:02:26.589552 22763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:26.590529 22763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c: No bootstrap required, opened a new log
I20251214 21:02:26.590878 22763 raft_consensus.cc:359] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec60a874bd584849a68f45cb29f4591c" member_type: VOTER }
I20251214 21:02:26.590960 22763 raft_consensus.cc:385] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:26.590993 22763 raft_consensus.cc:740] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec60a874bd584849a68f45cb29f4591c, State: Initialized, Role: FOLLOWER
I20251214 21:02:26.591096 22763 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec60a874bd584849a68f45cb29f4591c" member_type: VOTER }
I20251214 21:02:26.591152 22763 raft_consensus.cc:399] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:02:26.591177 22763 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:02:26.591209 22763 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:26.591830 22763 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec60a874bd584849a68f45cb29f4591c" member_type: VOTER }
I20251214 21:02:26.591945 22763 leader_election.cc:304] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec60a874bd584849a68f45cb29f4591c; no voters:
I20251214 21:02:26.592101 22763 leader_election.cc:290] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:02:26.592248 22766 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:02:26.592437 22766 raft_consensus.cc:697] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 1 LEADER]: Becoming Leader. State: Replica: ec60a874bd584849a68f45cb29f4591c, State: Running, Role: LEADER
I20251214 21:02:26.592474 22763 sys_catalog.cc:565] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:02:26.592579 22766 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec60a874bd584849a68f45cb29f4591c" member_type: VOTER }
I20251214 21:02:26.592979 22767 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec60a874bd584849a68f45cb29f4591c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec60a874bd584849a68f45cb29f4591c" member_type: VOTER } }
I20251214 21:02:26.593016 22768 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec60a874bd584849a68f45cb29f4591c. Latest consensus state: current_term: 1 leader_uuid: "ec60a874bd584849a68f45cb29f4591c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec60a874bd584849a68f45cb29f4591c" member_type: VOTER } }
I20251214 21:02:26.593072 22767 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [sys.catalog]: This master's current role is: LEADER
I20251214 21:02:26.593096 22768 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [sys.catalog]: This master's current role is: LEADER
I20251214 21:02:26.593739 22772 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:02:26.594432 22772 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:02:26.594645 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:02:26.596148 22772 catalog_manager.cc:1357] Generated new cluster ID: 8cbf2e285d7a4da381c7f89752b6c508
I20251214 21:02:26.596210 22772 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:02:26.612156 22772 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:02:26.612735 22772 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:02:26.623364 22772 catalog_manager.cc:6027] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c: Generated new TSK 0
I20251214 21:02:26.623545 22772 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:02:26.626507 20608 internal_mini_cluster.cc:371] 0 TS(s) registered with all masters after 5.0774e-05s
I20251214 21:02:38.707962 20608 master.cc:561] Master@127.20.32.62:42037 shutting down...
I20251214 21:02:38.712455 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:02:38.712682 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:38.712759 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P ec60a874bd584849a68f45cb29f4591c: stopping tablet replica
I20251214 21:02:38.725991 20608 master.cc:583] Master@127.20.32.62:42037 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfNoTservers (12167 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfNoTablets
I20251214 21:02:38.730214 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:42281
I20251214 21:02:38.730545 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:02:38.732463 20608 server_base.cc:1047] running on GCE node
W20251214 21:02:38.732491 22788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:38.732491 22785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:38.732654 22786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:38.732887 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:38.732928 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:38.732946 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746158732946 us; error 0 us; skew 500 ppm
I20251214 21:02:38.733994 20608 webserver.cc:492] Webserver started at http://127.20.32.62:45685/ using document root <none> and password file <none>
I20251214 21:02:38.734243 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:38.734297 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:38.734375 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:38.734877 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "09aa84b7eca1441791a3a888a19443f3"
format_stamp: "Formatted at 2025-12-14 21:02:38 on dist-test-slave-bphs"
I20251214 21:02:38.736295 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:02:38.737174 22793 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.737406 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:38.737468 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "09aa84b7eca1441791a3a888a19443f3"
format_stamp: "Formatted at 2025-12-14 21:02:38 on dist-test-slave-bphs"
I20251214 21:02:38.737526 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:38.745559 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:38.745924 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:38.749553 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:42281
I20251214 21:02:38.750072 22845 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:42281 every 8 connection(s)
I20251214 21:02:38.750573 22846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:38.752318 22846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3: Bootstrap starting.
I20251214 21:02:38.753060 22846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:38.754017 22846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3: No bootstrap required, opened a new log
I20251214 21:02:38.754438 22846 raft_consensus.cc:359] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09aa84b7eca1441791a3a888a19443f3" member_type: VOTER }
I20251214 21:02:38.754523 22846 raft_consensus.cc:385] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:38.754550 22846 raft_consensus.cc:740] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09aa84b7eca1441791a3a888a19443f3, State: Initialized, Role: FOLLOWER
I20251214 21:02:38.754668 22846 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09aa84b7eca1441791a3a888a19443f3" member_type: VOTER }
I20251214 21:02:38.754735 22846 raft_consensus.cc:399] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:02:38.754773 22846 raft_consensus.cc:493] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:02:38.754819 22846 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:38.755481 22846 raft_consensus.cc:515] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09aa84b7eca1441791a3a888a19443f3" member_type: VOTER }
I20251214 21:02:38.755599 22846 leader_election.cc:304] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09aa84b7eca1441791a3a888a19443f3; no voters:
I20251214 21:02:38.755751 22846 leader_election.cc:290] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:02:38.755848 22849 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:02:38.756096 22849 raft_consensus.cc:697] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 1 LEADER]: Becoming Leader. State: Replica: 09aa84b7eca1441791a3a888a19443f3, State: Running, Role: LEADER
I20251214 21:02:38.756145 22846 sys_catalog.cc:565] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:02:38.756238 22849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09aa84b7eca1441791a3a888a19443f3" member_type: VOTER }
I20251214 21:02:38.756682 22851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09aa84b7eca1441791a3a888a19443f3. Latest consensus state: current_term: 1 leader_uuid: "09aa84b7eca1441791a3a888a19443f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09aa84b7eca1441791a3a888a19443f3" member_type: VOTER } }
I20251214 21:02:38.756747 22851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [sys.catalog]: This master's current role is: LEADER
I20251214 21:02:38.756655 22850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09aa84b7eca1441791a3a888a19443f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09aa84b7eca1441791a3a888a19443f3" member_type: VOTER } }
I20251214 21:02:38.756789 22850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [sys.catalog]: This master's current role is: LEADER
I20251214 21:02:38.757010 22855 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:02:38.757925 22855 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:02:38.758091 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:02:38.759635 22855 catalog_manager.cc:1357] Generated new cluster ID: 5592a374386345efabd85f61971f1238
I20251214 21:02:38.759683 22855 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:02:38.774118 22855 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:02:38.774736 22855 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:02:38.779162 22855 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3: Generated new TSK 0
I20251214 21:02:38.779330 22855 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:02:38.790503 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:38.792294 22868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:38.792408 22867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:38.792450 22870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:38.792454 20608 server_base.cc:1047] running on GCE node
I20251214 21:02:38.792735 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:38.792771 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:38.792791 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746158792791 us; error 0 us; skew 500 ppm
I20251214 21:02:38.793542 20608 webserver.cc:492] Webserver started at http://127.20.32.1:39151/ using document root <none> and password file <none>
I20251214 21:02:38.793685 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:38.793772 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:38.793849 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:38.794219 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "2c177d9d66e845748b9fc9d5257183a7"
format_stamp: "Formatted at 2025-12-14 21:02:38 on dist-test-slave-bphs"
I20251214 21:02:38.795567 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:02:38.796458 22875 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.796711 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:38.796782 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "2c177d9d66e845748b9fc9d5257183a7"
format_stamp: "Formatted at 2025-12-14 21:02:38 on dist-test-slave-bphs"
I20251214 21:02:38.796849 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:38.804880 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:38.805253 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:38.805527 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:02:38.806020 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:02:38.806058 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.806097 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:02:38.806124 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.809975 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:46199
I20251214 21:02:38.810102 22938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:46199 every 8 connection(s)
I20251214 21:02:38.810820 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:38.812513 22944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:38.812520 22946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:38.812610 22943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:38.812793 20608 server_base.cc:1047] running on GCE node
I20251214 21:02:38.812963 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:38.813009 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:38.813035 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746158813035 us; error 0 us; skew 500 ppm
I20251214 21:02:38.813905 20608 webserver.cc:492] Webserver started at http://127.20.32.2:40803/ using document root <none> and password file <none>
I20251214 21:02:38.814051 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:38.814101 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:38.814172 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:38.814658 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "7b8a40ab20814a3ea82161d8c118782a"
format_stamp: "Formatted at 2025-12-14 21:02:38 on dist-test-slave-bphs"
I20251214 21:02:38.816114 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:38.817056 22951 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.817265 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:38.817322 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "7b8a40ab20814a3ea82161d8c118782a"
format_stamp: "Formatted at 2025-12-14 21:02:38 on dist-test-slave-bphs"
I20251214 21:02:38.817391 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:38.819195 22939 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42281
I20251214 21:02:38.819294 22939 heartbeater.cc:461] Registering TS with master...
I20251214 21:02:38.819530 22939 heartbeater.cc:507] Master 127.20.32.62:42281 requested a full tablet report, sending...
I20251214 21:02:38.820158 22810 ts_manager.cc:194] Registered new tserver with Master: 2c177d9d66e845748b9fc9d5257183a7 (127.20.32.1:46199)
I20251214 21:02:38.820917 22810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53834
I20251214 21:02:38.832659 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:38.833063 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:38.833348 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:02:38.833853 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:02:38.833894 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.833936 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:02:38.833963 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.837991 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:34263
I20251214 21:02:38.838014 23014 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:34263 every 8 connection(s)
I20251214 21:02:38.838836 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:38.840584 23019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:38.840636 23018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:38.840672 23021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:38.841019 20608 server_base.cc:1047] running on GCE node
I20251214 21:02:38.841214 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:38.841255 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:38.841276 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746158841276 us; error 0 us; skew 500 ppm
I20251214 21:02:38.842255 20608 webserver.cc:492] Webserver started at http://127.20.32.3:44867/ using document root <none> and password file <none>
I20251214 21:02:38.842410 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:38.842468 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:38.842545 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:38.842942 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "c39c48a2f2724a9497ef3885cb2e0ba8"
format_stamp: "Formatted at 2025-12-14 21:02:38 on dist-test-slave-bphs"
I20251214 21:02:38.843026 23015 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42281
I20251214 21:02:38.843113 23015 heartbeater.cc:461] Registering TS with master...
I20251214 21:02:38.843349 23015 heartbeater.cc:507] Master 127.20.32.62:42281 requested a full tablet report, sending...
I20251214 21:02:38.843935 22810 ts_manager.cc:194] Registered new tserver with Master: 7b8a40ab20814a3ea82161d8c118782a (127.20.32.2:34263)
I20251214 21:02:38.844507 22810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53850
I20251214 21:02:38.844614 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251214 21:02:38.845578 23026 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.845834 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:38.845892 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "c39c48a2f2724a9497ef3885cb2e0ba8"
format_stamp: "Formatted at 2025-12-14 21:02:38 on dist-test-slave-bphs"
I20251214 21:02:38.845947 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfNoTablets.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:38.871374 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:38.871814 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:38.872093 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:02:38.872573 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:02:38.872612 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.872643 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:02:38.872656 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:38.877308 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:41719
I20251214 21:02:38.877374 23089 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:41719 every 8 connection(s)
I20251214 21:02:38.881790 23090 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42281
I20251214 21:02:38.881907 23090 heartbeater.cc:461] Registering TS with master...
I20251214 21:02:38.882133 23090 heartbeater.cc:507] Master 127.20.32.62:42281 requested a full tablet report, sending...
I20251214 21:02:38.882797 22810 ts_manager.cc:194] Registered new tserver with Master: c39c48a2f2724a9497ef3885cb2e0ba8 (127.20.32.3:41719)
I20251214 21:02:38.883335 22810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53860
I20251214 21:02:38.883383 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005660562s
I20251214 21:02:39.821858 22939 heartbeater.cc:499] Master 127.20.32.62:42281 was elected leader, sending a full tablet report...
I20251214 21:02:39.845424 23015 heartbeater.cc:499] Master 127.20.32.62:42281 was elected leader, sending a full tablet report...
I20251214 21:02:39.884285 23090 heartbeater.cc:499] Master 127.20.32.62:42281 was elected leader, sending a full tablet report...
I20251214 21:02:40.758097 22864 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:42.758481 22864 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:44.758841 22864 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:46.759220 22864 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:48.759687 22864 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:50.760131 22864 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:50.962810 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:02:50.966661 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:02:50.978717 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:02:50.980774 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:02:50.984112 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:02:50.996066 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:02:50.998039 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:02:51.001837 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:02:51.014057 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:02:51.015966 20608 master.cc:561] Master@127.20.32.62:42281 shutting down...
I20251214 21:02:51.019448 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:02:51.019618 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:02:51.019666 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 09aa84b7eca1441791a3a888a19443f3: stopping tablet replica
I20251214 21:02:51.032720 20608 master.cc:583] Master@127.20.32.62:42281 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfNoTablets (12307 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne
I20251214 21:02:51.037693 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:45881
I20251214 21:02:51.038089 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:51.039794 23097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:51.039851 20608 server_base.cc:1047] running on GCE node
W20251214 21:02:51.039885 23095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:51.040023 23094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:51.040223 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:51.040266 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:51.040278 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746171040278 us; error 0 us; skew 500 ppm
I20251214 21:02:51.041067 20608 webserver.cc:492] Webserver started at http://127.20.32.62:34343/ using document root <none> and password file <none>
I20251214 21:02:51.041198 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:51.041234 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:51.041289 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:51.041623 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "b48451dba31a4f0880d36756660fb285"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.043049 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:51.044025 23102 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.044279 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:51.044350 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "b48451dba31a4f0880d36756660fb285"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.044425 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:51.068933 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:51.069357 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:51.073664 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:45881
I20251214 21:02:51.075248 23154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:45881 every 8 connection(s)
I20251214 21:02:51.075632 23155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:51.077421 23155 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285: Bootstrap starting.
I20251214 21:02:51.078289 23155 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:51.079406 23155 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285: No bootstrap required, opened a new log
I20251214 21:02:51.079790 23155 raft_consensus.cc:359] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48451dba31a4f0880d36756660fb285" member_type: VOTER }
I20251214 21:02:51.079882 23155 raft_consensus.cc:385] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:51.079903 23155 raft_consensus.cc:740] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b48451dba31a4f0880d36756660fb285, State: Initialized, Role: FOLLOWER
I20251214 21:02:51.080001 23155 consensus_queue.cc:260] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48451dba31a4f0880d36756660fb285" member_type: VOTER }
I20251214 21:02:51.080057 23155 raft_consensus.cc:399] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:02:51.080090 23155 raft_consensus.cc:493] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:02:51.080120 23155 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:51.080826 23155 raft_consensus.cc:515] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48451dba31a4f0880d36756660fb285" member_type: VOTER }
I20251214 21:02:51.080947 23155 leader_election.cc:304] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b48451dba31a4f0880d36756660fb285; no voters:
I20251214 21:02:51.081121 23155 leader_election.cc:290] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:02:51.081241 23158 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:02:51.081508 23158 raft_consensus.cc:697] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 1 LEADER]: Becoming Leader. State: Replica: b48451dba31a4f0880d36756660fb285, State: Running, Role: LEADER
I20251214 21:02:51.081565 23155 sys_catalog.cc:565] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:02:51.081655 23158 consensus_queue.cc:237] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48451dba31a4f0880d36756660fb285" member_type: VOTER }
I20251214 21:02:51.082119 23159 sys_catalog.cc:455] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b48451dba31a4f0880d36756660fb285" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48451dba31a4f0880d36756660fb285" member_type: VOTER } }
I20251214 21:02:51.082335 23159 sys_catalog.cc:458] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [sys.catalog]: This master's current role is: LEADER
I20251214 21:02:51.082140 23160 sys_catalog.cc:455] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b48451dba31a4f0880d36756660fb285. Latest consensus state: current_term: 1 leader_uuid: "b48451dba31a4f0880d36756660fb285" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48451dba31a4f0880d36756660fb285" member_type: VOTER } }
I20251214 21:02:51.082752 23164 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:02:51.082755 23160 sys_catalog.cc:458] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [sys.catalog]: This master's current role is: LEADER
I20251214 21:02:51.083607 23164 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:02:51.083834 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:02:51.085495 23164 catalog_manager.cc:1357] Generated new cluster ID: 19e31f3fdd0644a8b5b019052a4cdb96
I20251214 21:02:51.085549 23164 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:02:51.098770 23164 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:02:51.099381 23164 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:02:51.111599 23164 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285: Generated new TSK 0
I20251214 21:02:51.111900 23164 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:02:51.116377 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:51.119112 23179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:51.119153 23176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:51.119184 23177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:51.119455 20608 server_base.cc:1047] running on GCE node
I20251214 21:02:51.119694 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:51.119760 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:51.119782 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746171119781 us; error 0 us; skew 500 ppm
I20251214 21:02:51.120707 20608 webserver.cc:492] Webserver started at http://127.20.32.1:37757/ using document root <none> and password file <none>
I20251214 21:02:51.120869 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:51.120918 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:51.120977 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:51.121359 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "350624f5ace2428e865bf318f805c111"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.122895 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:02:51.123981 23184 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.124308 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:02:51.124389 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "350624f5ace2428e865bf318f805c111"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.124470 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:51.133416 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:51.133914 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:51.134213 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:02:51.134671 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:02:51.134709 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.134752 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:02:51.134781 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.138789 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:38047
I20251214 21:02:51.138819 23247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:38047 every 8 connection(s)
I20251214 21:02:51.139657 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:51.141641 23252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:51.141732 23253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:51.141827 20608 server_base.cc:1047] running on GCE node
W20251214 21:02:51.141690 23255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:51.142198 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:51.142264 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:51.142287 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746171142287 us; error 0 us; skew 500 ppm
I20251214 21:02:51.143342 20608 webserver.cc:492] Webserver started at http://127.20.32.2:35757/ using document root <none> and password file <none>
I20251214 21:02:51.143494 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:51.143543 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:51.143615 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:51.144016 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "549b33ab69bf49f19dc80facf6738626"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.144225 23248 heartbeater.cc:344] Connected to a master server at 127.20.32.62:45881
I20251214 21:02:51.144318 23248 heartbeater.cc:461] Registering TS with master...
I20251214 21:02:51.144567 23248 heartbeater.cc:507] Master 127.20.32.62:45881 requested a full tablet report, sending...
I20251214 21:02:51.145203 23119 ts_manager.cc:194] Registered new tserver with Master: 350624f5ace2428e865bf318f805c111 (127.20.32.1:38047)
I20251214 21:02:51.145630 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:51.146065 23119 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49844
I20251214 21:02:51.146685 23260 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.147001 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:51.147078 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "549b33ab69bf49f19dc80facf6738626"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.147138 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:51.165478 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:51.165951 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:51.166237 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:02:51.166713 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:02:51.166754 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.166783 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:02:51.166797 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.171397 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:46271
I20251214 21:02:51.171572 23323 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:46271 every 8 connection(s)
I20251214 21:02:51.172489 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:51.174383 23328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:51.174433 23327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:51.174723 23330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:51.174973 20608 server_base.cc:1047] running on GCE node
I20251214 21:02:51.175446 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:51.175623 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:51.175663 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746171175662 us; error 0 us; skew 500 ppm
I20251214 21:02:51.177034 20608 webserver.cc:492] Webserver started at http://127.20.32.3:40507/ using document root <none> and password file <none>
I20251214 21:02:51.177376 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:51.177487 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:51.177562 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:51.177691 23324 heartbeater.cc:344] Connected to a master server at 127.20.32.62:45881
I20251214 21:02:51.177852 23324 heartbeater.cc:461] Registering TS with master...
I20251214 21:02:51.178102 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "c5aff0f3b74244e2939a80da6f555f4f"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.178246 23324 heartbeater.cc:507] Master 127.20.32.62:45881 requested a full tablet report, sending...
I20251214 21:02:51.178988 23119 ts_manager.cc:194] Registered new tserver with Master: 549b33ab69bf49f19dc80facf6738626 (127.20.32.2:46271)
I20251214 21:02:51.179641 23119 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49856
I20251214 21:02:51.179860 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20251214 21:02:51.181073 23335 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.181373 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:02:51.181447 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "c5aff0f3b74244e2939a80da6f555f4f"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.181516 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:51.190402 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:51.191138 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:51.191653 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:02:51.192202 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:02:51.192245 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.192277 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:02:51.192304 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.198146 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:38925
I20251214 21:02:51.198200 23398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:38925 every 8 connection(s)
I20251214 21:02:51.199306 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:02:51.201423 23403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:51.201362 23402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:02:51.201504 23405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:02:51.201753 20608 server_base.cc:1047] running on GCE node
I20251214 21:02:51.201933 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:02:51.201975 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:02:51.202296 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746171202292 us; error 0 us; skew 500 ppm
I20251214 21:02:51.203317 20608 webserver.cc:492] Webserver started at http://127.20.32.4:34485/ using document root <none> and password file <none>
I20251214 21:02:51.203439 23399 heartbeater.cc:344] Connected to a master server at 127.20.32.62:45881
I20251214 21:02:51.203475 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:02:51.203527 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:02:51.203532 23399 heartbeater.cc:461] Registering TS with master...
I20251214 21:02:51.203612 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:02:51.203747 23399 heartbeater.cc:507] Master 127.20.32.62:45881 requested a full tablet report, sending...
I20251214 21:02:51.204010 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-3-root/instance:
uuid: "1ab0b2e25294481cbff5eaa3938bb24e"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.204294 23119 ts_manager.cc:194] Registered new tserver with Master: c5aff0f3b74244e2939a80da6f555f4f (127.20.32.3:38925)
I20251214 21:02:51.204810 23119 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49866
I20251214 21:02:51.205471 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251214 21:02:51.206398 23410 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.206667 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:51.206738 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-3-root
uuid: "1ab0b2e25294481cbff5eaa3938bb24e"
format_stamp: "Formatted at 2025-12-14 21:02:51 on dist-test-slave-bphs"
I20251214 21:02:51.206808 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne.1765746102914115-20608-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:02:51.218777 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:02:51.219245 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:02:51.219539 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:02:51.220010 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:02:51.220048 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.220100 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:02:51.220124 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:02:51.224586 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.4:39019
I20251214 21:02:51.224699 23473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.4:39019 every 8 connection(s)
I20251214 21:02:51.229157 23474 heartbeater.cc:344] Connected to a master server at 127.20.32.62:45881
I20251214 21:02:51.229278 23474 heartbeater.cc:461] Registering TS with master...
I20251214 21:02:51.229562 23474 heartbeater.cc:507] Master 127.20.32.62:45881 requested a full tablet report, sending...
I20251214 21:02:51.230186 23119 ts_manager.cc:194] Registered new tserver with Master: 1ab0b2e25294481cbff5eaa3938bb24e (127.20.32.4:39019)
I20251214 21:02:51.230661 20608 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.005647878s
I20251214 21:02:51.230729 23119 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49880
I20251214 21:02:52.147117 23248 heartbeater.cc:499] Master 127.20.32.62:45881 was elected leader, sending a full tablet report...
I20251214 21:02:52.180990 23324 heartbeater.cc:499] Master 127.20.32.62:45881 was elected leader, sending a full tablet report...
I20251214 21:02:52.205750 23399 heartbeater.cc:499] Master 127.20.32.62:45881 was elected leader, sending a full tablet report...
I20251214 21:02:52.231947 23474 heartbeater.cc:499] Master 127.20.32.62:45881 was elected leader, sending a full tablet report...
I20251214 21:02:52.268308 20608 test_util.cc:276] Using random seed: -782463215
I20251214 21:02:52.276314 23119 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49894:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251214 21:02:52.286091 23438 tablet_service.cc:1505] Processing CreateTablet for tablet 8ff87dffbc61492f932d9a9faa16977b (DEFAULT_TABLE table=test-workload [id=05d53d4ad42442d68448749c65b1eb3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:02:52.286263 23360 tablet_service.cc:1505] Processing CreateTablet for tablet 8ff87dffbc61492f932d9a9faa16977b (DEFAULT_TABLE table=test-workload [id=05d53d4ad42442d68448749c65b1eb3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:02:52.286463 23360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff87dffbc61492f932d9a9faa16977b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:52.286463 23438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff87dffbc61492f932d9a9faa16977b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:52.289052 23496 tablet_bootstrap.cc:492] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f: Bootstrap starting.
I20251214 21:02:52.289232 23212 tablet_service.cc:1505] Processing CreateTablet for tablet 8ff87dffbc61492f932d9a9faa16977b (DEFAULT_TABLE table=test-workload [id=05d53d4ad42442d68448749c65b1eb3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:02:52.289582 23212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff87dffbc61492f932d9a9faa16977b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:02:52.290159 23496 tablet_bootstrap.cc:654] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:52.290722 23495 tablet_bootstrap.cc:492] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e: Bootstrap starting.
I20251214 21:02:52.291582 23496 tablet_bootstrap.cc:492] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f: No bootstrap required, opened a new log
I20251214 21:02:52.291659 23496 ts_tablet_manager.cc:1403] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:02:52.291692 23495 tablet_bootstrap.cc:654] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:52.291922 23498 tablet_bootstrap.cc:492] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111: Bootstrap starting.
I20251214 21:02:52.292131 23496 raft_consensus.cc:359] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.292284 23496 raft_consensus.cc:385] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:52.292337 23496 raft_consensus.cc:740] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5aff0f3b74244e2939a80da6f555f4f, State: Initialized, Role: FOLLOWER
I20251214 21:02:52.292479 23496 consensus_queue.cc:260] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.292740 23495 tablet_bootstrap.cc:492] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e: No bootstrap required, opened a new log
I20251214 21:02:52.292819 23495 ts_tablet_manager.cc:1403] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:02:52.292846 23496 ts_tablet_manager.cc:1434] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:52.292948 23498 tablet_bootstrap.cc:654] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111: Neither blocks nor log segments found. Creating new log.
I20251214 21:02:52.293184 23495 raft_consensus.cc:359] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.293255 23495 raft_consensus.cc:385] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:52.293277 23495 raft_consensus.cc:740] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab0b2e25294481cbff5eaa3938bb24e, State: Initialized, Role: FOLLOWER
I20251214 21:02:52.293388 23495 consensus_queue.cc:260] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.293684 23495 ts_tablet_manager.cc:1434] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:52.294134 23498 tablet_bootstrap.cc:492] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111: No bootstrap required, opened a new log
I20251214 21:02:52.294219 23498 ts_tablet_manager.cc:1403] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:02:52.294656 23498 raft_consensus.cc:359] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.294771 23498 raft_consensus.cc:385] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:02:52.294806 23498 raft_consensus.cc:740] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 350624f5ace2428e865bf318f805c111, State: Initialized, Role: FOLLOWER
I20251214 21:02:52.295034 23498 consensus_queue.cc:260] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.295487 23498 ts_tablet_manager.cc:1434] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:02:52.384836 23500 raft_consensus.cc:493] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:02:52.384982 23500 raft_consensus.cc:515] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.385474 23500 leader_election.cc:290] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab0b2e25294481cbff5eaa3938bb24e (127.20.32.4:39019), 350624f5ace2428e865bf318f805c111 (127.20.32.1:38047)
I20251214 21:02:52.389587 23222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff87dffbc61492f932d9a9faa16977b" candidate_uuid: "c5aff0f3b74244e2939a80da6f555f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "350624f5ace2428e865bf318f805c111" is_pre_election: true
I20251214 21:02:52.389587 23448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff87dffbc61492f932d9a9faa16977b" candidate_uuid: "c5aff0f3b74244e2939a80da6f555f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" is_pre_election: true
I20251214 21:02:52.389827 23222 raft_consensus.cc:2468] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5aff0f3b74244e2939a80da6f555f4f in term 0.
I20251214 21:02:52.389827 23448 raft_consensus.cc:2468] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5aff0f3b74244e2939a80da6f555f4f in term 0.
I20251214 21:02:52.390178 23336 leader_election.cc:304] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1ab0b2e25294481cbff5eaa3938bb24e, 350624f5ace2428e865bf318f805c111, c5aff0f3b74244e2939a80da6f555f4f; no voters:
I20251214 21:02:52.390337 23500 raft_consensus.cc:2804] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:02:52.390391 23500 raft_consensus.cc:493] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:02:52.390420 23500 raft_consensus.cc:3060] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 0 FOLLOWER]: Advancing to term 1
W20251214 21:02:52.390673 23249 tablet.cc:2378] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:02:52.391431 23500 raft_consensus.cc:515] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.391770 23500 leader_election.cc:290] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [CANDIDATE]: Term 1 election: Requested vote from peers 1ab0b2e25294481cbff5eaa3938bb24e (127.20.32.4:39019), 350624f5ace2428e865bf318f805c111 (127.20.32.1:38047)
I20251214 21:02:52.392230 23448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff87dffbc61492f932d9a9faa16977b" candidate_uuid: "c5aff0f3b74244e2939a80da6f555f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab0b2e25294481cbff5eaa3938bb24e"
I20251214 21:02:52.392232 23222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ff87dffbc61492f932d9a9faa16977b" candidate_uuid: "c5aff0f3b74244e2939a80da6f555f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "350624f5ace2428e865bf318f805c111"
I20251214 21:02:52.392393 23222 raft_consensus.cc:3060] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:52.392393 23448 raft_consensus.cc:3060] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:02:52.393407 23448 raft_consensus.cc:2468] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5aff0f3b74244e2939a80da6f555f4f in term 1.
I20251214 21:02:52.393407 23222 raft_consensus.cc:2468] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5aff0f3b74244e2939a80da6f555f4f in term 1.
I20251214 21:02:52.393751 23336 leader_election.cc:304] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 350624f5ace2428e865bf318f805c111, c5aff0f3b74244e2939a80da6f555f4f; no voters:
I20251214 21:02:52.393976 23500 raft_consensus.cc:2804] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:02:52.394222 23500 raft_consensus.cc:697] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 1 LEADER]: Becoming Leader. State: Replica: c5aff0f3b74244e2939a80da6f555f4f, State: Running, Role: LEADER
I20251214 21:02:52.394375 23500 consensus_queue.cc:237] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } }
I20251214 21:02:52.395848 23117 catalog_manager.cc:5654] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f reported cstate change: term changed from 0 to 1, leader changed from <none> to c5aff0f3b74244e2939a80da6f555f4f (127.20.32.3). New cstate: current_term: 1 leader_uuid: "c5aff0f3b74244e2939a80da6f555f4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aff0f3b74244e2939a80da6f555f4f" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 38925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 } health_report { overall_health: UNKNOWN } } }
I20251214 21:02:52.863344 23500 consensus_queue.cc:1048] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "350624f5ace2428e865bf318f805c111" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:02:52.866276 23506 consensus_queue.cc:1048] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab0b2e25294481cbff5eaa3938bb24e" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 39019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:02:53.083642 23173 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:53.083933 23173 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:53.083997 23173 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:55.084312 23173 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:55.084638 23173 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:55.084698 23173 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:57.085032 23173 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:57.085379 23173 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:57.085438 23173 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:02:59.085793 23173 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:02:59.086114 23173 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:02:59.086176 23173 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:01.086515 23173 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:01.086866 23173 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:01.086930 23173 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:03.087230 23173 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:03.087563 23173 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:03.087644 23173 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:03.459355 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:03:03.462777 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:03.462996 20608 tablet_replica.cc:333] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111: stopping tablet replica
I20251214 21:03:03.463110 20608 raft_consensus.cc:2243] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:03.463219 20608 raft_consensus.cc:2272] T 8ff87dffbc61492f932d9a9faa16977b P 350624f5ace2428e865bf318f805c111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:03.475867 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:03:03.477813 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:03:03.481618 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:03.494776 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:03:03.496912 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:03:03.501415 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:03.501652 20608 tablet_replica.cc:333] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f: stopping tablet replica
I20251214 21:03:03.501781 20608 raft_consensus.cc:2243] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:03:03.501984 20608 raft_consensus.cc:2272] T 8ff87dffbc61492f932d9a9faa16977b P c5aff0f3b74244e2939a80da6f555f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:03.514803 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:03:03.516783 20608 tablet_server.cc:178] TabletServer@127.20.32.4:0 shutting down...
I20251214 21:03:03.520576 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:03.520771 20608 tablet_replica.cc:333] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e: stopping tablet replica
I20251214 21:03:03.520882 20608 raft_consensus.cc:2243] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:03.520999 20608 raft_consensus.cc:2272] T 8ff87dffbc61492f932d9a9faa16977b P 1ab0b2e25294481cbff5eaa3938bb24e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:03.533578 20608 tablet_server.cc:195] TabletServer@127.20.32.4:0 shutdown complete.
I20251214 21:03:03.535596 20608 master.cc:561] Master@127.20.32.62:45881 shutting down...
I20251214 21:03:03.539014 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:03:03.539175 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:03.539237 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P b48451dba31a4f0880d36756660fb285: stopping tablet replica
I20251214 21:03:03.551736 20608 master.cc:583] Master@127.20.32.62:45881 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfLocationLoadSkewedByOne (12520 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy
I20251214 21:03:03.557986 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:37913
I20251214 21:03:03.558311 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:03.559899 23523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:03.559942 23521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:03.559908 23520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:03.560111 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:03.560352 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:03.560395 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:03.560410 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746183560410 us; error 0 us; skew 500 ppm
I20251214 21:03:03.561175 20608 webserver.cc:492] Webserver started at http://127.20.32.62:42643/ using document root <none> and password file <none>
I20251214 21:03:03.561316 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:03.561360 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:03.561430 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:03.561852 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "95dc007d3a554a53880b983681bbe420"
format_stamp: "Formatted at 2025-12-14 21:03:03 on dist-test-slave-bphs"
I20251214 21:03:03.563316 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:03.564267 23528 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.564543 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:03.564613 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "95dc007d3a554a53880b983681bbe420"
format_stamp: "Formatted at 2025-12-14 21:03:03 on dist-test-slave-bphs"
I20251214 21:03:03.564683 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:03.570835 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:03.571178 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:03.574936 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:37913
I20251214 21:03:03.576736 23580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:37913 every 8 connection(s)
I20251214 21:03:03.577168 23581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:03.579136 23581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420: Bootstrap starting.
I20251214 21:03:03.579931 23581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:03.580937 23581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420: No bootstrap required, opened a new log
I20251214 21:03:03.581352 23581 raft_consensus.cc:359] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dc007d3a554a53880b983681bbe420" member_type: VOTER }
I20251214 21:03:03.581442 23581 raft_consensus.cc:385] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:03.581471 23581 raft_consensus.cc:740] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95dc007d3a554a53880b983681bbe420, State: Initialized, Role: FOLLOWER
I20251214 21:03:03.581599 23581 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dc007d3a554a53880b983681bbe420" member_type: VOTER }
I20251214 21:03:03.581668 23581 raft_consensus.cc:399] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:03:03.581727 23581 raft_consensus.cc:493] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:03:03.581774 23581 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:03.582455 23581 raft_consensus.cc:515] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dc007d3a554a53880b983681bbe420" member_type: VOTER }
I20251214 21:03:03.582574 23581 leader_election.cc:304] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95dc007d3a554a53880b983681bbe420; no voters:
I20251214 21:03:03.582737 23581 leader_election.cc:290] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:03:03.582888 23584 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:03.583074 23584 raft_consensus.cc:697] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 1 LEADER]: Becoming Leader. State: Replica: 95dc007d3a554a53880b983681bbe420, State: Running, Role: LEADER
I20251214 21:03:03.583143 23581 sys_catalog.cc:565] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:03:03.583194 23584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dc007d3a554a53880b983681bbe420" member_type: VOTER }
I20251214 21:03:03.583621 23585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95dc007d3a554a53880b983681bbe420" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dc007d3a554a53880b983681bbe420" member_type: VOTER } }
I20251214 21:03:03.583657 23586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95dc007d3a554a53880b983681bbe420. Latest consensus state: current_term: 1 leader_uuid: "95dc007d3a554a53880b983681bbe420" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dc007d3a554a53880b983681bbe420" member_type: VOTER } }
I20251214 21:03:03.583707 23585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [sys.catalog]: This master's current role is: LEADER
I20251214 21:03:03.583736 23586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [sys.catalog]: This master's current role is: LEADER
I20251214 21:03:03.584337 23589 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:03:03.585268 23589 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:03:03.585458 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:03:03.587175 23589 catalog_manager.cc:1357] Generated new cluster ID: ca38e99e8678430ea8e838404c0d039c
I20251214 21:03:03.587234 23589 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:03:03.595979 23589 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:03:03.596552 23589 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:03:03.606038 23589 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420: Generated new TSK 0
I20251214 21:03:03.606238 23589 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:03:03.618530 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:03.620756 23602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:03.620756 23605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:03.620841 20608 server_base.cc:1047] running on GCE node
W20251214 21:03:03.620959 23603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:03.621429 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:03.621482 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:03.621498 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746183621498 us; error 0 us; skew 500 ppm
I20251214 21:03:03.622392 20608 webserver.cc:492] Webserver started at http://127.20.32.1:33865/ using document root <none> and password file <none>
I20251214 21:03:03.622534 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:03.622576 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:03.622643 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:03.623010 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "706011c8e8174dec8dc6459a0fd25fb3"
format_stamp: "Formatted at 2025-12-14 21:03:03 on dist-test-slave-bphs"
I20251214 21:03:03.624514 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:03:03.625514 23610 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.625809 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:03.625885 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "706011c8e8174dec8dc6459a0fd25fb3"
format_stamp: "Formatted at 2025-12-14 21:03:03 on dist-test-slave-bphs"
I20251214 21:03:03.625953 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:03.656970 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:03.657370 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:03.657653 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:03.658138 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:03.658176 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.658217 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:03.658246 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.662101 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:37553
I20251214 21:03:03.662178 23673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:37553 every 8 connection(s)
I20251214 21:03:03.662907 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:03.664736 23678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:03.664860 20608 server_base.cc:1047] running on GCE node
W20251214 21:03:03.664803 23681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:03.664693 23679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:03.665231 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:03.665274 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:03.665325 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746183665324 us; error 0 us; skew 500 ppm
I20251214 21:03:03.666236 20608 webserver.cc:492] Webserver started at http://127.20.32.2:34353/ using document root <none> and password file <none>
I20251214 21:03:03.666389 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:03.666438 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:03.666509 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:03.666942 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "5d81b79e91674d61b25a259c4a3f09a3"
format_stamp: "Formatted at 2025-12-14 21:03:03 on dist-test-slave-bphs"
I20251214 21:03:03.667191 23674 heartbeater.cc:344] Connected to a master server at 127.20.32.62:37913
I20251214 21:03:03.667284 23674 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:03.667493 23674 heartbeater.cc:507] Master 127.20.32.62:37913 requested a full tablet report, sending...
I20251214 21:03:03.668097 23545 ts_manager.cc:194] Registered new tserver with Master: 706011c8e8174dec8dc6459a0fd25fb3 (127.20.32.1:37553)
I20251214 21:03:03.668576 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251214 21:03:03.668864 23545 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35612
I20251214 21:03:03.669569 23686 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.669821 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:03.669888 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "5d81b79e91674d61b25a259c4a3f09a3"
format_stamp: "Formatted at 2025-12-14 21:03:03 on dist-test-slave-bphs"
I20251214 21:03:03.669942 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:03.679787 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:03.680364 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:03.680649 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:03.681119 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:03.681155 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.681186 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:03.681200 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.685191 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:38919
I20251214 21:03:03.685247 23749 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:38919 every 8 connection(s)
I20251214 21:03:03.686021 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:03.688073 23756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:03.688186 23753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:03.688052 23754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:03.688310 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:03.688544 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:03.688601 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:03.688623 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746183688623 us; error 0 us; skew 500 ppm
I20251214 21:03:03.689611 20608 webserver.cc:492] Webserver started at http://127.20.32.3:36151/ using document root <none> and password file <none>
I20251214 21:03:03.689826 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:03.689898 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:03.689966 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:03.690433 23750 heartbeater.cc:344] Connected to a master server at 127.20.32.62:37913
I20251214 21:03:03.690501 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "220c66ea32204b37bbe9828466cb93a2"
format_stamp: "Formatted at 2025-12-14 21:03:03 on dist-test-slave-bphs"
I20251214 21:03:03.690539 23750 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:03.690802 23750 heartbeater.cc:507] Master 127.20.32.62:37913 requested a full tablet report, sending...
I20251214 21:03:03.691380 23545 ts_manager.cc:194] Registered new tserver with Master: 5d81b79e91674d61b25a259c4a3f09a3 (127.20.32.2:38919)
I20251214 21:03:03.691910 23545 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35620
I20251214 21:03:03.692121 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:03:03.693027 23761 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.693246 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:03.693310 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "220c66ea32204b37bbe9828466cb93a2"
format_stamp: "Formatted at 2025-12-14 21:03:03 on dist-test-slave-bphs"
I20251214 21:03:03.693377 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:03.709595 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:03.710026 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:03.710311 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:03.710836 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:03.710877 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.710918 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:03.710947 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:03.715337 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:43999
I20251214 21:03:03.715433 23824 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:43999 every 8 connection(s)
I20251214 21:03:03.719691 23825 heartbeater.cc:344] Connected to a master server at 127.20.32.62:37913
I20251214 21:03:03.719790 23825 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:03.719997 23825 heartbeater.cc:507] Master 127.20.32.62:37913 requested a full tablet report, sending...
I20251214 21:03:03.720574 23545 ts_manager.cc:194] Registered new tserver with Master: 220c66ea32204b37bbe9828466cb93a2 (127.20.32.3:43999)
I20251214 21:03:03.721064 23545 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35634
I20251214 21:03:03.721494 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005749506s
I20251214 21:03:04.669764 23674 heartbeater.cc:499] Master 127.20.32.62:37913 was elected leader, sending a full tablet report...
I20251214 21:03:04.692797 23750 heartbeater.cc:499] Master 127.20.32.62:37913 was elected leader, sending a full tablet report...
I20251214 21:03:04.722080 23825 heartbeater.cc:499] Master 127.20.32.62:37913 was elected leader, sending a full tablet report...
I20251214 21:03:04.752657 20608 test_util.cc:276] Using random seed: -769978866
I20251214 21:03:04.760074 23545 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35654:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:03:04.760509 23545 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:03:04.770515 23789 tablet_service.cc:1505] Processing CreateTablet for tablet 0b946b28214642bf8b9acd3c9535baa3 (DEFAULT_TABLE table=test-workload [id=df0684dce0b74eb9b504e5506e617b1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:03:04.770886 23789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b946b28214642bf8b9acd3c9535baa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:04.770928 23638 tablet_service.cc:1505] Processing CreateTablet for tablet 0b946b28214642bf8b9acd3c9535baa3 (DEFAULT_TABLE table=test-workload [id=df0684dce0b74eb9b504e5506e617b1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:03:04.771138 23638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b946b28214642bf8b9acd3c9535baa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:04.773512 23847 tablet_bootstrap.cc:492] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2: Bootstrap starting.
I20251214 21:03:04.773742 23714 tablet_service.cc:1505] Processing CreateTablet for tablet 0b946b28214642bf8b9acd3c9535baa3 (DEFAULT_TABLE table=test-workload [id=df0684dce0b74eb9b504e5506e617b1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:03:04.773989 23714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b946b28214642bf8b9acd3c9535baa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:04.774497 23847 tablet_bootstrap.cc:654] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:04.775179 23846 tablet_bootstrap.cc:492] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3: Bootstrap starting.
I20251214 21:03:04.776186 23849 tablet_bootstrap.cc:492] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3: Bootstrap starting.
I20251214 21:03:04.776294 23846 tablet_bootstrap.cc:654] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:04.776866 23847 tablet_bootstrap.cc:492] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2: No bootstrap required, opened a new log
I20251214 21:03:04.777022 23847 ts_tablet_manager.cc:1403] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:03:04.777204 23849 tablet_bootstrap.cc:654] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:04.777499 23847 raft_consensus.cc:359] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.777607 23847 raft_consensus.cc:385] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:04.777637 23847 raft_consensus.cc:740] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220c66ea32204b37bbe9828466cb93a2, State: Initialized, Role: FOLLOWER
I20251214 21:03:04.777799 23847 consensus_queue.cc:260] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.778133 23846 tablet_bootstrap.cc:492] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3: No bootstrap required, opened a new log
I20251214 21:03:04.778203 23847 ts_tablet_manager.cc:1434] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:04.778249 23849 tablet_bootstrap.cc:492] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3: No bootstrap required, opened a new log
I20251214 21:03:04.778281 23846 ts_tablet_manager.cc:1403] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:03:04.778401 23849 ts_tablet_manager.cc:1403] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251214 21:03:04.778785 23846 raft_consensus.cc:359] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.778829 23849 raft_consensus.cc:359] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.779043 23846 raft_consensus.cc:385] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:04.779098 23846 raft_consensus.cc:740] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706011c8e8174dec8dc6459a0fd25fb3, State: Initialized, Role: FOLLOWER
I20251214 21:03:04.779106 23849 raft_consensus.cc:385] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:04.779196 23849 raft_consensus.cc:740] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d81b79e91674d61b25a259c4a3f09a3, State: Initialized, Role: FOLLOWER
I20251214 21:03:04.779286 23846 consensus_queue.cc:260] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.779366 23849 consensus_queue.cc:260] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.779666 23846 ts_tablet_manager.cc:1434] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:04.779726 23849 ts_tablet_manager.cc:1434] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:04.952399 23852 raft_consensus.cc:493] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:04.952566 23852 raft_consensus.cc:515] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.953094 23852 leader_election.cc:290] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d81b79e91674d61b25a259c4a3f09a3 (127.20.32.2:38919), 706011c8e8174dec8dc6459a0fd25fb3 (127.20.32.1:37553)
I20251214 21:03:04.956580 23648 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b946b28214642bf8b9acd3c9535baa3" candidate_uuid: "220c66ea32204b37bbe9828466cb93a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706011c8e8174dec8dc6459a0fd25fb3" is_pre_election: true
I20251214 21:03:04.956653 23724 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b946b28214642bf8b9acd3c9535baa3" candidate_uuid: "220c66ea32204b37bbe9828466cb93a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d81b79e91674d61b25a259c4a3f09a3" is_pre_election: true
I20251214 21:03:04.956725 23648 raft_consensus.cc:2468] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 220c66ea32204b37bbe9828466cb93a2 in term 0.
I20251214 21:03:04.956779 23724 raft_consensus.cc:2468] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 220c66ea32204b37bbe9828466cb93a2 in term 0.
I20251214 21:03:04.957049 23763 leader_election.cc:304] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220c66ea32204b37bbe9828466cb93a2, 706011c8e8174dec8dc6459a0fd25fb3; no voters:
I20251214 21:03:04.957216 23852 raft_consensus.cc:2804] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:04.957283 23852 raft_consensus.cc:493] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:04.957314 23852 raft_consensus.cc:3060] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:04.958209 23852 raft_consensus.cc:515] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.958593 23852 leader_election.cc:290] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [CANDIDATE]: Term 1 election: Requested vote from peers 5d81b79e91674d61b25a259c4a3f09a3 (127.20.32.2:38919), 706011c8e8174dec8dc6459a0fd25fb3 (127.20.32.1:37553)
I20251214 21:03:04.958877 23724 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b946b28214642bf8b9acd3c9535baa3" candidate_uuid: "220c66ea32204b37bbe9828466cb93a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d81b79e91674d61b25a259c4a3f09a3"
I20251214 21:03:04.958889 23648 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b946b28214642bf8b9acd3c9535baa3" candidate_uuid: "220c66ea32204b37bbe9828466cb93a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706011c8e8174dec8dc6459a0fd25fb3"
I20251214 21:03:04.958974 23724 raft_consensus.cc:3060] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:04.959002 23648 raft_consensus.cc:3060] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:04.959818 23724 raft_consensus.cc:2468] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220c66ea32204b37bbe9828466cb93a2 in term 1.
I20251214 21:03:04.959834 23648 raft_consensus.cc:2468] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220c66ea32204b37bbe9828466cb93a2 in term 1.
I20251214 21:03:04.960078 23762 leader_election.cc:304] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220c66ea32204b37bbe9828466cb93a2, 5d81b79e91674d61b25a259c4a3f09a3; no voters:
I20251214 21:03:04.960227 23852 raft_consensus.cc:2804] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:04.960443 23852 raft_consensus.cc:697] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 1 LEADER]: Becoming Leader. State: Replica: 220c66ea32204b37bbe9828466cb93a2, State: Running, Role: LEADER
I20251214 21:03:04.960572 23852 consensus_queue.cc:237] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } }
I20251214 21:03:04.962085 23542 catalog_manager.cc:5654] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 220c66ea32204b37bbe9828466cb93a2 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "220c66ea32204b37bbe9828466cb93a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220c66ea32204b37bbe9828466cb93a2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 43999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:05.356427 23852 consensus_queue.cc:1048] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d81b79e91674d61b25a259c4a3f09a3" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 38919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:05.359748 23862 consensus_queue.cc:1048] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706011c8e8174dec8dc6459a0fd25fb3" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:05.585040 23599 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:05.585345 23599 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:05.585305 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:05.585412 23599 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:06.587173 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:07.585758 23599 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:07.586097 23599 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:07.586158 23599 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:07.588584 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:08.590157 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:09.586472 23599 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:09.586815 23599 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:09.586872 23599 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:09.591748 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:10.593281 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:11.587218 23599 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:11.587535 23599 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:11.587596 23599 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:11.595142 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:12.596668 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:13.587947 23599 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:13.588284 23599 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:13.588342 23599 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:13.598270 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:14.599835 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:15.588666 23599 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:15.588949 23599 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:15.589012 23599 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:15.601348 23593 placement_policy_util.cc:407] tablet 0b946b28214642bf8b9acd3c9535baa3: detected majority of replicas (2 of 3) at location L0
I20251214 21:03:16.060467 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:03:16.064116 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:16.064337 20608 tablet_replica.cc:333] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3: stopping tablet replica
I20251214 21:03:16.064446 20608 raft_consensus.cc:2243] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:16.064555 20608 raft_consensus.cc:2272] T 0b946b28214642bf8b9acd3c9535baa3 P 706011c8e8174dec8dc6459a0fd25fb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:16.078090 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:03:16.080448 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:03:16.084215 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:16.084416 20608 tablet_replica.cc:333] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3: stopping tablet replica
I20251214 21:03:16.084529 20608 raft_consensus.cc:2243] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:16.084652 20608 raft_consensus.cc:2272] T 0b946b28214642bf8b9acd3c9535baa3 P 5d81b79e91674d61b25a259c4a3f09a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:16.097252 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:03:16.099313 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:03:16.102430 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:16.102618 20608 tablet_replica.cc:333] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2: stopping tablet replica
I20251214 21:03:16.102725 20608 raft_consensus.cc:2243] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:03:16.102905 20608 raft_consensus.cc:2272] T 0b946b28214642bf8b9acd3c9535baa3 P 220c66ea32204b37bbe9828466cb93a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:16.115453 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:03:16.117425 20608 master.cc:561] Master@127.20.32.62:37913 shutting down...
I20251214 21:03:16.120887 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:03:16.121054 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:16.121117 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 95dc007d3a554a53880b983681bbe420: stopping tablet replica
I20251214 21:03:16.133525 20608 master.cc:583] Master@127.20.32.62:37913 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfCannotFixPlacementPolicy (12581 ms)
[ RUN ] AutoRebalancerTest.TestMaxMovesPerServer
I20251214 21:03:16.139750 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:36169
I20251214 21:03:16.140091 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:16.141917 23874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:16.141921 23871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:16.142035 23872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:16.142148 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:16.142274 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:16.142314 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:16.142334 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746196142333 us; error 0 us; skew 500 ppm
I20251214 21:03:16.143132 20608 webserver.cc:492] Webserver started at http://127.20.32.62:45699/ using document root <none> and password file <none>
I20251214 21:03:16.143272 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:16.143319 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:16.143394 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:16.143780 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "cccb6adcb4834ef9ab61c50fa532f0ab"
format_stamp: "Formatted at 2025-12-14 21:03:16 on dist-test-slave-bphs"
I20251214 21:03:16.145135 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:16.146092 23879 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.146304 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:16.146368 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "cccb6adcb4834ef9ab61c50fa532f0ab"
format_stamp: "Formatted at 2025-12-14 21:03:16 on dist-test-slave-bphs"
I20251214 21:03:16.146435 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:16.177922 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:16.178297 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:16.181967 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:36169
I20251214 21:03:16.183758 23931 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:36169 every 8 connection(s)
I20251214 21:03:16.184176 23932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:16.186007 23932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab: Bootstrap starting.
I20251214 21:03:16.186765 23932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:16.187808 23932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab: No bootstrap required, opened a new log
I20251214 21:03:16.188190 23932 raft_consensus.cc:359] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccb6adcb4834ef9ab61c50fa532f0ab" member_type: VOTER }
I20251214 21:03:16.188279 23932 raft_consensus.cc:385] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:16.188309 23932 raft_consensus.cc:740] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cccb6adcb4834ef9ab61c50fa532f0ab, State: Initialized, Role: FOLLOWER
I20251214 21:03:16.188421 23932 consensus_queue.cc:260] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccb6adcb4834ef9ab61c50fa532f0ab" member_type: VOTER }
I20251214 21:03:16.188488 23932 raft_consensus.cc:399] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:03:16.188519 23932 raft_consensus.cc:493] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:03:16.188565 23932 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:16.189244 23932 raft_consensus.cc:515] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccb6adcb4834ef9ab61c50fa532f0ab" member_type: VOTER }
I20251214 21:03:16.189365 23932 leader_election.cc:304] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cccb6adcb4834ef9ab61c50fa532f0ab; no voters:
I20251214 21:03:16.189536 23932 leader_election.cc:290] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:03:16.189672 23935 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:16.189926 23935 raft_consensus.cc:697] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 1 LEADER]: Becoming Leader. State: Replica: cccb6adcb4834ef9ab61c50fa532f0ab, State: Running, Role: LEADER
I20251214 21:03:16.189997 23932 sys_catalog.cc:565] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:03:16.190096 23935 consensus_queue.cc:237] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccb6adcb4834ef9ab61c50fa532f0ab" member_type: VOTER }
I20251214 21:03:16.190513 23937 sys_catalog.cc:455] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader cccb6adcb4834ef9ab61c50fa532f0ab. Latest consensus state: current_term: 1 leader_uuid: "cccb6adcb4834ef9ab61c50fa532f0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccb6adcb4834ef9ab61c50fa532f0ab" member_type: VOTER } }
I20251214 21:03:16.190490 23936 sys_catalog.cc:455] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cccb6adcb4834ef9ab61c50fa532f0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cccb6adcb4834ef9ab61c50fa532f0ab" member_type: VOTER } }
I20251214 21:03:16.190728 23937 sys_catalog.cc:458] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [sys.catalog]: This master's current role is: LEADER
I20251214 21:03:16.190747 23936 sys_catalog.cc:458] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [sys.catalog]: This master's current role is: LEADER
I20251214 21:03:16.191134 23943 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:03:16.191937 23943 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:03:16.192085 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:03:16.193756 23943 catalog_manager.cc:1357] Generated new cluster ID: 8c5f91f1014040bcb16b935a0e784e9d
I20251214 21:03:16.193811 23943 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:03:16.201812 23943 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:03:16.202353 23943 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:03:16.215914 23943 catalog_manager.cc:6027] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab: Generated new TSK 0
I20251214 21:03:16.216099 23943 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:03:16.224568 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:16.226446 23956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:16.226584 20608 server_base.cc:1047] running on GCE node
W20251214 21:03:16.226666 23954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:16.226675 23953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:16.226975 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:16.227028 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:16.227049 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746196227048 us; error 0 us; skew 500 ppm
I20251214 21:03:16.227788 20608 webserver.cc:492] Webserver started at http://127.20.32.1:35825/ using document root <none> and password file <none>
I20251214 21:03:16.227933 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:16.227985 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:16.228057 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:16.228416 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "126ee409f2314ba091e87159b26c0c62"
format_stamp: "Formatted at 2025-12-14 21:03:16 on dist-test-slave-bphs"
I20251214 21:03:16.229830 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:16.230769 23961 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.230988 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:16.231050 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "126ee409f2314ba091e87159b26c0c62"
format_stamp: "Formatted at 2025-12-14 21:03:16 on dist-test-slave-bphs"
I20251214 21:03:16.231117 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:16.243465 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:16.243875 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:16.244161 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:16.244589 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:16.244627 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.244666 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:16.244694 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.248545 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:39681
I20251214 21:03:16.248572 24024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:39681 every 8 connection(s)
I20251214 21:03:16.249253 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:16.250928 24029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:16.251029 24032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:16.251076 24030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:16.251168 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:16.251507 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:16.251549 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:16.251569 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746196251569 us; error 0 us; skew 500 ppm
I20251214 21:03:16.252405 20608 webserver.cc:492] Webserver started at http://127.20.32.2:41669/ using document root <none> and password file <none>
I20251214 21:03:16.252550 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:16.252594 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:16.252641 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:16.253072 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "68bf8595326044d78e9d47fe858479d4"
format_stamp: "Formatted at 2025-12-14 21:03:16 on dist-test-slave-bphs"
I20251214 21:03:16.253461 24025 heartbeater.cc:344] Connected to a master server at 127.20.32.62:36169
I20251214 21:03:16.253556 24025 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:16.253816 24025 heartbeater.cc:507] Master 127.20.32.62:36169 requested a full tablet report, sending...
I20251214 21:03:16.254406 23896 ts_manager.cc:194] Registered new tserver with Master: 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681)
I20251214 21:03:16.254580 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:03:16.255342 23896 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55098
I20251214 21:03:16.255558 24037 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.255784 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:16.255852 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "68bf8595326044d78e9d47fe858479d4"
format_stamp: "Formatted at 2025-12-14 21:03:16 on dist-test-slave-bphs"
I20251214 21:03:16.255918 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:16.261673 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:16.262028 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:16.262264 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:16.262638 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:16.262671 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.262698 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:16.262712 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.266549 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:36087
I20251214 21:03:16.266609 24100 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:36087 every 8 connection(s)
I20251214 21:03:16.267271 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:16.269126 24104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:16.269207 24107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:16.269176 24105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:16.269413 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:16.269590 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:16.269625 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:16.269645 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746196269644 us; error 0 us; skew 500 ppm
I20251214 21:03:16.270531 20608 webserver.cc:492] Webserver started at http://127.20.32.3:42239/ using document root <none> and password file <none>
I20251214 21:03:16.270687 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:16.270741 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:16.270812 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:16.271239 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "fe19ae24b84b428e8559931c04f1a6b2"
format_stamp: "Formatted at 2025-12-14 21:03:16 on dist-test-slave-bphs"
I20251214 21:03:16.271276 24101 heartbeater.cc:344] Connected to a master server at 127.20.32.62:36169
I20251214 21:03:16.271364 24101 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:16.271660 24101 heartbeater.cc:507] Master 127.20.32.62:36169 requested a full tablet report, sending...
I20251214 21:03:16.272301 23896 ts_manager.cc:194] Registered new tserver with Master: 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:16.272732 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:03:16.272820 23896 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55108
I20251214 21:03:16.273665 24112 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.273960 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:16.274034 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "fe19ae24b84b428e8559931c04f1a6b2"
format_stamp: "Formatted at 2025-12-14 21:03:16 on dist-test-slave-bphs"
I20251214 21:03:16.274102 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:16.292294 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:16.292714 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:16.293020 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:16.293479 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:16.293519 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.293560 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:16.293587 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:16.298581 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:32947
I20251214 21:03:16.298629 24175 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:32947 every 8 connection(s)
I20251214 21:03:16.303267 24176 heartbeater.cc:344] Connected to a master server at 127.20.32.62:36169
I20251214 21:03:16.303390 24176 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:16.303625 24176 heartbeater.cc:507] Master 127.20.32.62:36169 requested a full tablet report, sending...
I20251214 21:03:16.304342 23896 ts_manager.cc:194] Registered new tserver with Master: fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:16.304684 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005721759s
I20251214 21:03:16.304981 23896 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55124
I20251214 21:03:17.256354 24025 heartbeater.cc:499] Master 127.20.32.62:36169 was elected leader, sending a full tablet report...
I20251214 21:03:17.273739 24101 heartbeater.cc:499] Master 127.20.32.62:36169 was elected leader, sending a full tablet report...
I20251214 21:03:17.306000 24176 heartbeater.cc:499] Master 127.20.32.62:36169 was elected leader, sending a full tablet report...
I20251214 21:03:17.331633 20608 test_util.cc:276] Using random seed: -757399893
I20251214 21:03:17.340989 23896 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55134:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\252\252\252\n\004\001\000TUU\025\004\001\000\376\377\377\037\004\001\000\250\252\252*\004\001\000RUU5\004\001\000\374\377\377?\004\001\000\246\252\252J\004\001\000PUUU\004\001\000\372\377\377_\004\001\000\244\252\252j\004\001\000NUUu""\004\001\000\252\252\252\n\004\001\000TUU\025\004\001\000\376\377\377\037\004\001\000\250\252\252*\004\001\000RUU5\004\001\000\374\377\377?\004\001\000\246\252\252J\004\001\000PUUU\004\001\000\372\377\377_\004\001\000\244\252\252j\004\001\000NUUu"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:03:17.341646 23896 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:03:17.357142 23989 tablet_service.cc:1505] Processing CreateTablet for tablet 01da8ce246384c7cb83053adfcffe77a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION VALUES < 178956970
I20251214 21:03:17.357357 23984 tablet_service.cc:1505] Processing CreateTablet for tablet d13b1d13a93d4cc3940537b29baf147a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 894784850 <= VALUES < 1073741820
I20251214 21:03:17.357517 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01da8ce246384c7cb83053adfcffe77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.357468 24137 tablet_service.cc:1505] Processing CreateTablet for tablet 4c649579f0f94f23aca3eafa7d81df2e (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 715827880
I20251214 21:03:17.357658 23984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13b1d13a93d4cc3940537b29baf147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.357772 24137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c649579f0f94f23aca3eafa7d81df2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.357468 24136 tablet_service.cc:1505] Processing CreateTablet for tablet d9efc0482ebe4a30a7b08b9190e72cdf (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 715827880 <= VALUES < 894784850
I20251214 21:03:17.357941 24136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9efc0482ebe4a30a7b08b9190e72cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.358186 24138 tablet_service.cc:1505] Processing CreateTablet for tablet d246d019db6f483dab560d45620c2aec (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 357913940 <= VALUES < 536870910
I20251214 21:03:17.358393 24138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d246d019db6f483dab560d45620c2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.360203 23988 tablet_service.cc:1505] Processing CreateTablet for tablet f19d4d6bfd10472094bb7a6f81cd06b4 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 178956970 <= VALUES < 357913940
I20251214 21:03:17.360368 24139 tablet_service.cc:1505] Processing CreateTablet for tablet f19d4d6bfd10472094bb7a6f81cd06b4 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 178956970 <= VALUES < 357913940
I20251214 21:03:17.360539 23988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19d4d6bfd10472094bb7a6f81cd06b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.360611 24139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19d4d6bfd10472094bb7a6f81cd06b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.361387 24136 tablet_service.cc:1505] Processing CreateTablet for tablet d13b1d13a93d4cc3940537b29baf147a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 894784850 <= VALUES < 1073741820
I20251214 21:03:17.361392 23989 tablet_service.cc:1505] Processing CreateTablet for tablet 0d4b592c0409483384330ac5cfcbe8b5 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1252698790
I20251214 21:03:17.361621 24136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13b1d13a93d4cc3940537b29baf147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.361824 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4b592c0409483384330ac5cfcbe8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.362780 23986 tablet_service.cc:1505] Processing CreateTablet for tablet 4c649579f0f94f23aca3eafa7d81df2e (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 715827880
I20251214 21:03:17.362813 24140 tablet_service.cc:1505] Processing CreateTablet for tablet 01da8ce246384c7cb83053adfcffe77a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION VALUES < 178956970
I20251214 21:03:17.363015 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c649579f0f94f23aca3eafa7d81df2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.363036 24140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01da8ce246384c7cb83053adfcffe77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.364732 23989 tablet_service.cc:1505] Processing CreateTablet for tablet 3628382de7514932a1ea8072fb2eaeb8 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1252698790 <= VALUES < 1431655760
I20251214 21:03:17.364993 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3628382de7514932a1ea8072fb2eaeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.365128 23985 tablet_service.cc:1505] Processing CreateTablet for tablet d9efc0482ebe4a30a7b08b9190e72cdf (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 715827880 <= VALUES < 894784850
I20251214 21:03:17.365355 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9efc0482ebe4a30a7b08b9190e72cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.367166 24136 tablet_service.cc:1505] Processing CreateTablet for tablet 14f65411fb9c45b0892ef02beae5b884 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1431655760 <= VALUES < 1610612730
I20251214 21:03:17.367394 24136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f65411fb9c45b0892ef02beae5b884. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.367429 24140 tablet_service.cc:1505] Processing CreateTablet for tablet 3628382de7514932a1ea8072fb2eaeb8 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1252698790 <= VALUES < 1431655760
I20251214 21:03:17.357158 23987 tablet_service.cc:1505] Processing CreateTablet for tablet d246d019db6f483dab560d45620c2aec (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 357913940 <= VALUES < 536870910
I20251214 21:03:17.367638 24140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3628382de7514932a1ea8072fb2eaeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.367728 23987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d246d019db6f483dab560d45620c2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.367821 24138 tablet_service.cc:1505] Processing CreateTablet for tablet 445f6b3b3b63458abdaa3054956e957b (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1789569700 <= VALUES < 1968526670
I20251214 21:03:17.368021 24138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f6b3b3b63458abdaa3054956e957b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.369508 24137 tablet_service.cc:1505] Processing CreateTablet for tablet 0d4b592c0409483384330ac5cfcbe8b5 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1252698790
I20251214 21:03:17.369767 24137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4b592c0409483384330ac5cfcbe8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.370075 23987 tablet_service.cc:1505] Processing CreateTablet for tablet 14f65411fb9c45b0892ef02beae5b884 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1431655760 <= VALUES < 1610612730
I20251214 21:03:17.370177 23985 tablet_service.cc:1505] Processing CreateTablet for tablet f498cd6fedac4052b7593b1dda35af6a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1789569700
I20251214 21:03:17.370286 23987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f65411fb9c45b0892ef02beae5b884. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.370424 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f498cd6fedac4052b7593b1dda35af6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.367208 24196 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.371745 24139 tablet_service.cc:1505] Processing CreateTablet for tablet f498cd6fedac4052b7593b1dda35af6a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1789569700
I20251214 21:03:17.371960 24139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f498cd6fedac4052b7593b1dda35af6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.372309 23986 tablet_service.cc:1505] Processing CreateTablet for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1968526670 <= VALUES
I20251214 21:03:17.372509 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.372555 23989 tablet_service.cc:1505] Processing CreateTablet for tablet 445f6b3b3b63458abdaa3054956e957b (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1789569700 <= VALUES < 1968526670
I20251214 21:03:17.372793 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f6b3b3b63458abdaa3054956e957b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.371491 24196 tablet_bootstrap.cc:654] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.375262 24196 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.375360 24196 ts_tablet_manager.cc:1403] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251214 21:03:17.375469 24197 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.375612 24139 tablet_service.cc:1505] Processing CreateTablet for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1968526670 <= VALUES
I20251214 21:03:17.375833 24139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.376480 24197 tablet_bootstrap.cc:654] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.376641 24065 tablet_service.cc:1505] Processing CreateTablet for tablet 01da8ce246384c7cb83053adfcffe77a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION VALUES < 178956970
I20251214 21:03:17.376888 24065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01da8ce246384c7cb83053adfcffe77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.377512 24197 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.377596 24197 ts_tablet_manager.cc:1403] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:03:17.375828 24196 raft_consensus.cc:359] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.377780 24196 raft_consensus.cc:385] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.377820 24196 raft_consensus.cc:740] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.377967 24196 consensus_queue.cc:260] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.378052 24197 raft_consensus.cc:359] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.378150 24197 raft_consensus.cc:385] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.378185 24197 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.378300 24197 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.378326 24196 ts_tablet_manager.cc:1434] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:03:17.378552 24196 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.378634 24056 tablet_service.cc:1505] Processing CreateTablet for tablet f498cd6fedac4052b7593b1dda35af6a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1789569700
I20251214 21:03:17.378858 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f498cd6fedac4052b7593b1dda35af6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.379110 24065 tablet_service.cc:1505] Processing CreateTablet for tablet 445f6b3b3b63458abdaa3054956e957b (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1789569700 <= VALUES < 1968526670
I20251214 21:03:17.379321 24065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f6b3b3b63458abdaa3054956e957b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.379431 24196 tablet_bootstrap.cc:654] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.380100 24197 ts_tablet_manager.cc:1434] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.380457 24196 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.380538 24196 ts_tablet_manager.cc:1403] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.380790 24056 tablet_service.cc:1505] Processing CreateTablet for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1968526670 <= VALUES
I20251214 21:03:17.380918 24196 raft_consensus.cc:359] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.381011 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.381011 24196 raft_consensus.cc:385] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.381338 24196 raft_consensus.cc:740] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.381492 24196 consensus_queue.cc:260] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.381853 24196 ts_tablet_manager.cc:1434] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.381932 24057 tablet_service.cc:1505] Processing CreateTablet for tablet 14f65411fb9c45b0892ef02beae5b884 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1431655760 <= VALUES < 1610612730
I20251214 21:03:17.382117 24197 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.382191 24057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f65411fb9c45b0892ef02beae5b884. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.382017 24196 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.383576 24196 tablet_bootstrap.cc:654] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.384161 24201 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.384289 24058 tablet_service.cc:1505] Processing CreateTablet for tablet 3628382de7514932a1ea8072fb2eaeb8 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1252698790 <= VALUES < 1431655760
I20251214 21:03:17.384519 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3628382de7514932a1ea8072fb2eaeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.384572 24197 tablet_bootstrap.cc:654] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.385068 24201 tablet_bootstrap.cc:654] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.385351 24196 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.385432 24196 ts_tablet_manager.cc:1403] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:03:17.385891 24196 raft_consensus.cc:359] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.385982 24196 raft_consensus.cc:385] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.386010 24196 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.386096 24201 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.386138 24196 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.386183 24201 ts_tablet_manager.cc:1403] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.386483 24196 ts_tablet_manager.cc:1434] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.386619 24201 raft_consensus.cc:359] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.386659 24059 tablet_service.cc:1505] Processing CreateTablet for tablet 0d4b592c0409483384330ac5cfcbe8b5 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1252698790
I20251214 21:03:17.386718 24201 raft_consensus.cc:385] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.386765 24201 raft_consensus.cc:740] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.386906 24059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4b592c0409483384330ac5cfcbe8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.386883 24201 consensus_queue.cc:260] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.387001 24196 tablet_bootstrap.cc:492] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.387230 24201 ts_tablet_manager.cc:1434] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.386884 24197 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.387648 24197 ts_tablet_manager.cc:1403] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251214 21:03:17.387912 24196 tablet_bootstrap.cc:654] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.388175 24197 raft_consensus.cc:359] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.388329 24197 raft_consensus.cc:385] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.388408 24197 raft_consensus.cc:740] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.388598 24197 consensus_queue.cc:260] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.389009 24197 ts_tablet_manager.cc:1434] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.389223 24197 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.389185 24060 tablet_service.cc:1505] Processing CreateTablet for tablet d13b1d13a93d4cc3940537b29baf147a (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 894784850 <= VALUES < 1073741820
I20251214 21:03:17.389485 24061 tablet_service.cc:1505] Processing CreateTablet for tablet d9efc0482ebe4a30a7b08b9190e72cdf (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 715827880 <= VALUES < 894784850
I20251214 21:03:17.389487 24060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13b1d13a93d4cc3940537b29baf147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.389123 24196 tablet_bootstrap.cc:492] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.390048 24196 ts_tablet_manager.cc:1403] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:03:17.390007 24062 tablet_service.cc:1505] Processing CreateTablet for tablet 4c649579f0f94f23aca3eafa7d81df2e (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 715827880
I20251214 21:03:17.390244 24062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c649579f0f94f23aca3eafa7d81df2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.390450 24196 raft_consensus.cc:359] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.390537 24196 raft_consensus.cc:385] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.390565 24196 raft_consensus.cc:740] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.390669 24196 consensus_queue.cc:260] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.390902 24196 ts_tablet_manager.cc:1434] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.391108 24196 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.392053 24196 tablet_bootstrap.cc:654] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.392387 24063 tablet_service.cc:1505] Processing CreateTablet for tablet d246d019db6f483dab560d45620c2aec (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 357913940 <= VALUES < 536870910
I20251214 21:03:17.392650 24063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d246d019db6f483dab560d45620c2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.393095 24197 tablet_bootstrap.cc:654] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.393316 24196 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.393399 24196 ts_tablet_manager.cc:1403] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.393819 24196 raft_consensus.cc:359] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.393920 24196 raft_consensus.cc:385] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.393950 24196 raft_consensus.cc:740] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.394093 24196 consensus_queue.cc:260] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.394352 24196 ts_tablet_manager.cc:1434] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.394503 24196 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.395045 24064 tablet_service.cc:1505] Processing CreateTablet for tablet f19d4d6bfd10472094bb7a6f81cd06b4 (DEFAULT_TABLE table=test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]), partition=RANGE (key) PARTITION 178956970 <= VALUES < 357913940
I20251214 21:03:17.395305 24064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19d4d6bfd10472094bb7a6f81cd06b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.395424 24196 tablet_bootstrap.cc:654] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.395727 24201 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.396484 24196 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.396565 24196 ts_tablet_manager.cc:1403] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.396942 24196 raft_consensus.cc:359] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.397054 24196 raft_consensus.cc:385] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.397094 24196 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.397223 24196 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.397281 24201 tablet_bootstrap.cc:654] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.397372 24061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9efc0482ebe4a30a7b08b9190e72cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:17.398104 24196 ts_tablet_manager.cc:1434] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.398279 24196 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.398514 24201 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.398586 24201 ts_tablet_manager.cc:1403] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:03:17.398990 24201 raft_consensus.cc:359] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.399082 24201 raft_consensus.cc:385] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.399112 24201 raft_consensus.cc:740] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.399143 24196 tablet_bootstrap.cc:654] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.399225 24201 consensus_queue.cc:260] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.399555 24201 ts_tablet_manager.cc:1434] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.399713 24201 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.400177 24197 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.400249 24197 ts_tablet_manager.cc:1403] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251214 21:03:17.400594 24201 tablet_bootstrap.cc:654] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.400624 24197 raft_consensus.cc:359] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.400707 24197 raft_consensus.cc:385] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.400739 24197 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.401105 24196 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.401182 24196 ts_tablet_manager.cc:1403] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:03:17.401543 24196 raft_consensus.cc:359] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.401743 24196 raft_consensus.cc:385] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.401788 24196 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.401834 24201 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.401908 24201 ts_tablet_manager.cc:1403] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:03:17.401902 24196 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.402163 24196 ts_tablet_manager.cc:1434] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:17.402335 24196 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.402311 24201 raft_consensus.cc:359] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.402388 24201 raft_consensus.cc:385] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.402415 24201 raft_consensus.cc:740] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.402544 24201 consensus_queue.cc:260] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.402878 24201 ts_tablet_manager.cc:1434] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.403026 24201 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.403271 24196 tablet_bootstrap.cc:654] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.401490 24197 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.404071 24197 ts_tablet_manager.cc:1434] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251214 21:03:17.404243 24197 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.404732 24201 tablet_bootstrap.cc:654] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.404986 24196 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.405117 24196 ts_tablet_manager.cc:1403] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251214 21:03:17.405104 24197 tablet_bootstrap.cc:654] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.405647 24196 raft_consensus.cc:359] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.405827 24196 raft_consensus.cc:385] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.405901 24196 raft_consensus.cc:740] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.406028 24196 consensus_queue.cc:260] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.406294 24196 ts_tablet_manager.cc:1434] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:17.406450 24201 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.406495 24197 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.406550 24201 ts_tablet_manager.cc:1403] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:03:17.406550 24197 ts_tablet_manager.cc:1403] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:03:17.406463 24196 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.407037 24201 raft_consensus.cc:359] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.407163 24201 raft_consensus.cc:385] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.407191 24201 raft_consensus.cc:740] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.407294 24201 consensus_queue.cc:260] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.407536 24201 ts_tablet_manager.cc:1434] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.407037 24197 raft_consensus.cc:359] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.407620 24197 raft_consensus.cc:385] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.407658 24197 raft_consensus.cc:740] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.407704 24201 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.407784 24196 tablet_bootstrap.cc:654] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.407761 24197 consensus_queue.cc:260] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.407989 24197 ts_tablet_manager.cc:1434] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.408150 24197 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.408643 24201 tablet_bootstrap.cc:654] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.408993 24197 tablet_bootstrap.cc:654] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.409657 24203 raft_consensus.cc:493] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.409683 24201 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.409817 24201 ts_tablet_manager.cc:1403] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.409777 24203 raft_consensus.cc:515] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.410233 24201 raft_consensus.cc:359] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.410327 24201 raft_consensus.cc:385] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.410358 24201 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.410424 24197 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.410485 24197 ts_tablet_manager.cc:1403] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:03:17.410470 24201 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.410704 24201 ts_tablet_manager.cc:1434] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:17.410362 24203 leader_election.cc:290] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.410869 24201 tablet_bootstrap.cc:492] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.410869 24197 raft_consensus.cc:359] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.411100 24197 raft_consensus.cc:385] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.411130 24197 raft_consensus.cc:740] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.411219 24197 consensus_queue.cc:260] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.411445 24197 ts_tablet_manager.cc:1434] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.411583 24197 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.411773 24201 tablet_bootstrap.cc:654] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.411782 24196 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.412468 24196 ts_tablet_manager.cc:1403] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251214 21:03:17.412485 24197 tablet_bootstrap.cc:654] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.413015 24196 raft_consensus.cc:359] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.413126 24196 raft_consensus.cc:385] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.413162 24196 raft_consensus.cc:740] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.413280 24196 consensus_queue.cc:260] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.413501 24197 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.413571 24196 ts_tablet_manager.cc:1434] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:17.413576 24197 ts_tablet_manager.cc:1403] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.414173 24197 raft_consensus.cc:359] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.414319 24197 raft_consensus.cc:385] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.414397 24197 raft_consensus.cc:740] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.414584 24197 consensus_queue.cc:260] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.414965 24197 ts_tablet_manager.cc:1434] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.415174 24197 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.416146 24197 tablet_bootstrap.cc:654] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.414427 24196 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.418330 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d246d019db6f483dab560d45620c2aec" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62" is_pre_election: true
I20251214 21:03:17.418479 23999 raft_consensus.cc:2468] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 0.
I20251214 21:03:17.418776 24114 leader_election.cc:304] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.418342 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d246d019db6f483dab560d45620c2aec" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.420024 24196 tablet_bootstrap.cc:654] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
W20251214 21:03:17.420217 24116 leader_election.cc:343] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): Illegal state: must be running to vote when last-logged opid is not known
I20251214 21:03:17.422189 24201 tablet_bootstrap.cc:492] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.422228 24196 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.422320 24196 ts_tablet_manager.cc:1403] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251214 21:03:17.422330 24201 ts_tablet_manager.cc:1403] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20251214 21:03:17.422833 24196 raft_consensus.cc:359] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.422945 24196 raft_consensus.cc:385] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.422976 24196 raft_consensus.cc:740] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.423098 24201 raft_consensus.cc:359] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.423107 24196 consensus_queue.cc:260] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.423230 24201 raft_consensus.cc:385] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.423264 24201 raft_consensus.cc:740] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.423540 24201 consensus_queue.cc:260] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.423764 24196 ts_tablet_manager.cc:1434] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.423898 24203 raft_consensus.cc:2804] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.423949 24203 raft_consensus.cc:493] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.423969 24196 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.423985 24203 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.424988 24196 tablet_bootstrap.cc:654] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.425056 24203 raft_consensus.cc:515] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.425463 24203 leader_election.cc:290] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.425948 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d246d019db6f483dab560d45620c2aec" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:17.426066 23999 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.427088 23999 raft_consensus.cc:2468] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 1.
I20251214 21:03:17.427522 24114 leader_election.cc:304] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.427559 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d246d019db6f483dab560d45620c2aec" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.427843 24203 raft_consensus.cc:493] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.427918 24203 raft_consensus.cc:515] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
W20251214 21:03:17.427937 24116 leader_election.cc:343] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): Illegal state: must be running to vote when last-logged opid is not known
I20251214 21:03:17.428145 24211 raft_consensus.cc:2804] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.428265 24203 leader_election.cc:290] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.428339 24211 raft_consensus.cc:697] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:17.428468 24211 consensus_queue.cc:237] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.428706 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62" is_pre_election: true
I20251214 21:03:17.428814 23999 raft_consensus.cc:2468] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 0.
I20251214 21:03:17.428985 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
W20251214 21:03:17.429265 24116 leader_election.cc:343] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): Illegal state: must be running to vote when last-logged opid is not known
I20251214 21:03:17.429418 24114 leader_election.cc:304] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters: 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:17.423784 24201 ts_tablet_manager.cc:1434] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:17.429677 24197 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.429797 24197 ts_tablet_manager.cc:1403] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.001s
I20251214 21:03:17.429860 24201 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.430265 24197 raft_consensus.cc:359] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.430464 24197 raft_consensus.cc:385] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.430523 24197 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.430648 24197 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.430912 24197 ts_tablet_manager.cc:1434] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:17.431069 24197 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.431071 24201 tablet_bootstrap.cc:654] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.431185 24232 raft_consensus.cc:2804] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.431232 24232 raft_consensus.cc:493] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.431272 24232 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.431939 24197 tablet_bootstrap.cc:654] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.432457 24232 raft_consensus.cc:515] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.433023 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:17.433136 23999 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.433583 24232 leader_election.cc:290] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.433796 24196 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.433887 24196 ts_tablet_manager.cc:1403] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251214 21:03:17.434011 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.434302 23999 raft_consensus.cc:2468] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 1.
W20251214 21:03:17.434345 24116 leader_election.cc:343] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): Illegal state: must be running to vote when last-logged opid is not known
I20251214 21:03:17.434371 24196 raft_consensus.cc:359] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.434592 24196 raft_consensus.cc:385] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.434628 24196 raft_consensus.cc:740] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.434746 24196 consensus_queue.cc:260] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.435153 24114 leader_election.cc:304] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters: 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:17.435362 24211 raft_consensus.cc:2804] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.435437 24211 raft_consensus.cc:697] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:17.435544 24211 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.435745 24196 ts_tablet_manager.cc:1434] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.435926 24196 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: Bootstrap starting.
I20251214 21:03:17.436429 23895 catalog_manager.cc:5654] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } }
I20251214 21:03:17.436918 24196 tablet_bootstrap.cc:654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.437337 24201 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.437415 24201 ts_tablet_manager.cc:1403] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251214 21:03:17.437885 24201 raft_consensus.cc:359] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.437980 24201 raft_consensus.cc:385] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.438010 24201 raft_consensus.cc:740] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.438125 24201 consensus_queue.cc:260] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.438655 24196 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: No bootstrap required, opened a new log
I20251214 21:03:17.438745 24196 ts_tablet_manager.cc:1403] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:03:17.439167 24196 raft_consensus.cc:359] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.439258 24196 raft_consensus.cc:385] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.439289 24196 raft_consensus.cc:740] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.439409 24196 consensus_queue.cc:260] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.439666 24196 ts_tablet_manager.cc:1434] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.439958 23895 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } }
I20251214 21:03:17.440515 24201 ts_tablet_manager.cc:1434] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:03:17.440975 24201 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.442081 24201 tablet_bootstrap.cc:654] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.443668 24201 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.443763 24201 ts_tablet_manager.cc:1403] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:03:17.444227 24201 raft_consensus.cc:359] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.444350 24201 raft_consensus.cc:385] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.444380 24201 raft_consensus.cc:740] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.444610 24201 consensus_queue.cc:260] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.444880 24201 ts_tablet_manager.cc:1434] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.445078 24201 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.446187 24201 tablet_bootstrap.cc:654] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.447256 24201 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.447345 24201 ts_tablet_manager.cc:1403] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251214 21:03:17.447659 24197 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.447743 24197 ts_tablet_manager.cc:1403] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.002s
I20251214 21:03:17.448123 24201 raft_consensus.cc:359] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.448159 24197 raft_consensus.cc:359] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.448244 24197 raft_consensus.cc:385] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.448279 24197 raft_consensus.cc:740] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.448388 24197 consensus_queue.cc:260] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.448628 24197 ts_tablet_manager.cc:1434] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:17.448805 24197 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.449894 24197 tablet_bootstrap.cc:654] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.450469 24201 raft_consensus.cc:385] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.450525 24201 raft_consensus.cc:740] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.450654 24201 consensus_queue.cc:260] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.451031 24201 ts_tablet_manager.cc:1434] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251214 21:03:17.451654 24201 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.452771 24201 tablet_bootstrap.cc:654] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.453950 24197 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.454093 24197 ts_tablet_manager.cc:1403] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251214 21:03:17.454211 24201 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.454289 24201 ts_tablet_manager.cc:1403] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251214 21:03:17.454560 24197 raft_consensus.cc:359] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.454627 24201 raft_consensus.cc:359] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.454677 24197 raft_consensus.cc:385] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.454692 24201 raft_consensus.cc:385] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.454718 24197 raft_consensus.cc:740] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.454741 24201 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.454838 24201 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.454838 24197 consensus_queue.cc:260] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.455132 24201 ts_tablet_manager.cc:1434] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:17.455196 24197 ts_tablet_manager.cc:1434] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:17.455300 24201 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.455351 24197 tablet_bootstrap.cc:492] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.456338 24201 tablet_bootstrap.cc:654] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.456441 24197 tablet_bootstrap.cc:654] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.457005 24200 raft_consensus.cc:493] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.457096 24200 raft_consensus.cc:515] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.457495 24201 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.457580 24201 ts_tablet_manager.cc:1403] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:17.457605 24200 leader_election.cc:290] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.458055 24201 raft_consensus.cc:359] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.458159 24201 raft_consensus.cc:385] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.458197 24201 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.458331 24201 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.458609 24201 ts_tablet_manager.cc:1434] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:17.458803 24201 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: Bootstrap starting.
I20251214 21:03:17.459818 24201 tablet_bootstrap.cc:654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.459916 24200 raft_consensus.cc:493] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.459997 24200 raft_consensus.cc:515] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.460350 24200 leader_election.cc:290] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.462306 24201 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: No bootstrap required, opened a new log
I20251214 21:03:17.462337 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "445f6b3b3b63458abdaa3054956e957b" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2" is_pre_election: true
I20251214 21:03:17.462404 24201 ts_tablet_manager.cc:1403] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251214 21:03:17.462482 24150 raft_consensus.cc:2468] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.462378 24149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2" is_pre_election: true
I20251214 21:03:17.462664 24149 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.462771 23964 leader_election.cc:304] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.462852 24201 raft_consensus.cc:359] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.462942 23964 leader_election.cc:304] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.462921 24200 raft_consensus.cc:2804] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.462934 24201 raft_consensus.cc:385] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.463016 24200 raft_consensus.cc:493] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.463018 24201 raft_consensus.cc:740] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.463068 24200 raft_consensus.cc:3060] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.463227 24201 consensus_queue.cc:260] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.463477 24201 ts_tablet_manager.cc:1434] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:17.464165 24200 raft_consensus.cc:515] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.464515 24200 leader_election.cc:290] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.464689 24197 tablet_bootstrap.cc:492] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.463101 24208 raft_consensus.cc:2804] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.464766 24208 raft_consensus.cc:493] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.464798 24197 ts_tablet_manager.cc:1403] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20251214 21:03:17.464864 24208 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.464895 24074 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.464991 24074 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.465265 24197 raft_consensus.cc:359] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.465344 24197 raft_consensus.cc:385] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.465373 24197 raft_consensus.cc:740] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.465488 24197 consensus_queue.cc:260] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.465505 24073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "445f6b3b3b63458abdaa3054956e957b" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.465597 24073 raft_consensus.cc:3060] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.465797 24197 ts_tablet_manager.cc:1434] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.465828 24208 raft_consensus.cc:515] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.465991 24197 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.466156 24208 leader_election.cc:290] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.466728 24149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "445f6b3b3b63458abdaa3054956e957b" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:17.466828 24149 raft_consensus.cc:3060] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.467000 24073 raft_consensus.cc:2468] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.467043 24197 tablet_bootstrap.cc:654] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.464660 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "445f6b3b3b63458abdaa3054956e957b" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.467536 24075 raft_consensus.cc:2376] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1. Re-sending same reply.
I20251214 21:03:17.467880 24149 raft_consensus.cc:2468] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.468101 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:17.468191 23964 leader_election.cc:304] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.468223 24150 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.468446 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.468549 24075 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.469126 24150 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.469305 24208 raft_consensus.cc:2804] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.469367 23964 leader_election.cc:304] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.469513 24200 raft_consensus.cc:2804] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.469604 24200 raft_consensus.cc:697] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:17.469762 24200 consensus_queue.cc:237] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.470367 24197 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.470455 24197 ts_tablet_manager.cc:1403] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251214 21:03:17.469386 24208 raft_consensus.cc:697] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:17.469386 24075 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.470711 24208 consensus_queue.cc:237] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.470912 24197 raft_consensus.cc:359] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.471019 24197 raft_consensus.cc:385] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.471058 24197 raft_consensus.cc:740] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.471185 24197 consensus_queue.cc:260] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.471536 24197 ts_tablet_manager.cc:1434] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:17.471750 24197 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: Bootstrap starting.
I20251214 21:03:17.471947 24216 raft_consensus.cc:493] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.472023 24216 raft_consensus.cc:515] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.472458 24216 leader_election.cc:290] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.472512 23895 catalog_manager.cc:5654] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:17.472813 24197 tablet_bootstrap.cc:654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:17.474334 24197 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: No bootstrap required, opened a new log
I20251214 21:03:17.474428 24197 ts_tablet_manager.cc:1403] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:03:17.474882 24197 raft_consensus.cc:359] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.474985 24197 raft_consensus.cc:385] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:17.475018 24197 raft_consensus.cc:740] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Initialized, Role: FOLLOWER
I20251214 21:03:17.475121 24197 consensus_queue.cc:260] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.475770 24197 ts_tablet_manager.cc:1434] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:17.476974 23894 catalog_manager.cc:5654] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:17.478809 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2" is_pre_election: true
I20251214 21:03:17.478936 24150 raft_consensus.cc:2468] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 0.
I20251214 21:03:17.479211 24040 leader_election.cc:304] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.479384 24216 raft_consensus.cc:2804] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.479432 24216 raft_consensus.cc:493] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.479473 24216 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.480536 24216 raft_consensus.cc:515] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.480645 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62" is_pre_election: true
I20251214 21:03:17.480739 23999 raft_consensus.cc:2468] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 0.
I20251214 21:03:17.480914 24216 leader_election.cc:290] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.481212 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:17.481252 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:17.481344 23999 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.481309 24150 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.482189 23999 raft_consensus.cc:2468] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 1.
I20251214 21:03:17.482446 24039 leader_election.cc:304] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:17.482520 24150 raft_consensus.cc:2468] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 1.
I20251214 21:03:17.482596 24216 raft_consensus.cc:2804] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.482666 24216 raft_consensus.cc:697] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:17.482784 24216 consensus_queue.cc:237] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.484318 23894 catalog_manager.cc:5654] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 1 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:17.486215 24216 raft_consensus.cc:493] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.486400 24216 raft_consensus.cc:515] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.486929 24216 leader_election.cc:290] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.487418 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2" is_pre_election: true
I20251214 21:03:17.487445 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62" is_pre_election: true
I20251214 21:03:17.487556 24150 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 0.
I20251214 21:03:17.487577 23999 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 0.
I20251214 21:03:17.487875 24040 leader_election.cc:304] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.488060 24216 raft_consensus.cc:2804] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.488214 24216 raft_consensus.cc:493] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.488287 24216 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.489096 24216 raft_consensus.cc:515] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.489431 24216 leader_election.cc:290] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.489799 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:17.489799 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:17.489945 24150 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.489955 23999 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.490847 23999 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 1.
I20251214 21:03:17.490847 24150 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 1.
I20251214 21:03:17.491137 24039 leader_election.cc:304] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:17.491304 24216 raft_consensus.cc:2804] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.491406 24216 raft_consensus.cc:697] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:17.491535 24216 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.493181 23894 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 1 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:17.554780 24216 raft_consensus.cc:493] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.554948 24216 raft_consensus.cc:515] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.555414 24216 leader_election.cc:290] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.555922 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62" is_pre_election: true
I20251214 21:03:17.555922 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2" is_pre_election: true
I20251214 21:03:17.556111 23999 raft_consensus.cc:2393] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68bf8595326044d78e9d47fe858479d4 in current term 1: Already voted for candidate fe19ae24b84b428e8559931c04f1a6b2 in this term.
I20251214 21:03:17.556442 24040 leader_election.cc:304] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4; no voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2
I20251214 21:03:17.556598 24216 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.557504 24216 raft_consensus.cc:2749] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251214 21:03:17.566365 24208 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.566526 24208 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.566958 24208 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.567459 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.567582 24075 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.567620 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2" is_pre_election: true
I20251214 21:03:17.567911 24150 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.567984 23965 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:17.568265 24208 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.568364 24208 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.568405 24208 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.569253 24208 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.569586 24208 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.569979 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.570025 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:17.570084 24075 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.570118 24150 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.570813 24150 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.570827 24075 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.571090 23964 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.571255 24208 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.571333 24208 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:17.571556 24208 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.573267 23894 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:17.632444 24232 raft_consensus.cc:493] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.632612 24232 raft_consensus.cc:515] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.633045 24232 leader_election.cc:290] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.633464 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62" is_pre_election: true
I20251214 21:03:17.633481 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.633606 23999 raft_consensus.cc:2468] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 0.
I20251214 21:03:17.633623 24075 raft_consensus.cc:2468] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 0.
I20251214 21:03:17.633911 24116 leader_election.cc:304] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.634064 24232 raft_consensus.cc:2804] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.634119 24232 raft_consensus.cc:493] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.634146 24232 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.635048 24232 raft_consensus.cc:515] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.635354 24232 leader_election.cc:290] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.635717 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.635717 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:17.635811 24075 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.635854 23999 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.636485 24075 raft_consensus.cc:2468] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 1.
I20251214 21:03:17.636540 23999 raft_consensus.cc:2468] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 1.
I20251214 21:03:17.636745 24116 leader_election.cc:304] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.636948 24232 raft_consensus.cc:2804] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.637033 24232 raft_consensus.cc:697] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:17.637166 24232 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.638842 23894 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } }
I20251214 21:03:17.639451 24232 raft_consensus.cc:493] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.639521 24232 raft_consensus.cc:515] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.639842 24232 leader_election.cc:290] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.640113 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62" is_pre_election: true
I20251214 21:03:17.640113 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.640245 24075 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 0.
I20251214 21:03:17.640245 23999 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 0.
I20251214 21:03:17.640501 24116 leader_election.cc:304] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.640631 24232 raft_consensus.cc:2804] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.640690 24232 raft_consensus.cc:493] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.640738 24232 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.641551 24232 raft_consensus.cc:515] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.641873 24232 leader_election.cc:290] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.642143 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.642226 24075 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.642946 24075 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 1.
I20251214 21:03:17.643137 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:17.643235 24116 leader_election.cc:304] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.643239 23999 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.643395 24232 raft_consensus.cc:2804] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.643476 24232 raft_consensus.cc:697] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:17.643584 24232 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.644126 23999 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 1.
I20251214 21:03:17.645196 23894 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } }
I20251214 21:03:17.646641 24208 raft_consensus.cc:493] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.646737 24208 raft_consensus.cc:515] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.647097 24208 leader_election.cc:290] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.647393 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d13b1d13a93d4cc3940537b29baf147a" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2" is_pre_election: true
I20251214 21:03:17.647467 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d13b1d13a93d4cc3940537b29baf147a" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.647504 24150 raft_consensus.cc:2468] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.647570 24075 raft_consensus.cc:2468] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.647760 23964 leader_election.cc:304] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.647953 24208 raft_consensus.cc:2804] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.647996 24208 raft_consensus.cc:493] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.648034 24208 raft_consensus.cc:3060] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.648698 24208 raft_consensus.cc:515] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.648975 24208 leader_election.cc:290] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:17.649312 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d13b1d13a93d4cc3940537b29baf147a" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.649312 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d13b1d13a93d4cc3940537b29baf147a" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:17.649457 24150 raft_consensus.cc:3060] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.649457 24075 raft_consensus.cc:3060] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.650372 24150 raft_consensus.cc:2468] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.650372 24075 raft_consensus.cc:2468] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.650687 23964 leader_election.cc:304] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.650928 24208 raft_consensus.cc:2804] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.651010 24208 raft_consensus.cc:697] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:17.651141 24208 consensus_queue.cc:237] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.652793 23894 catalog_manager.cc:5654] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:17.677883 24232 raft_consensus.cc:493] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.678040 24232 raft_consensus.cc:515] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.678449 24232 leader_election.cc:290] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.678897 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62" is_pre_election: true
I20251214 21:03:17.678900 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.679024 23999 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 0.
I20251214 21:03:17.679062 24075 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 0.
I20251214 21:03:17.679301 24114 leader_election.cc:304] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.679453 24232 raft_consensus.cc:2804] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.679505 24232 raft_consensus.cc:493] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.679534 24232 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.680306 24232 raft_consensus.cc:515] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.680606 24232 leader_election.cc:290] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.680979 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.681020 23999 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:17.681067 24075 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.681124 23999 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.681937 24075 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 1.
I20251214 21:03:17.682106 23999 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 1.
I20251214 21:03:17.682209 24116 leader_election.cc:304] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.682363 24232 raft_consensus.cc:2804] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.682458 24232 raft_consensus.cc:697] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:17.682617 24232 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:17.684150 23894 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } }
I20251214 21:03:17.807953 24208 raft_consensus.cc:493] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:17.808126 24208 raft_consensus.cc:515] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.808519 24208 leader_election.cc:290] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.808977 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01da8ce246384c7cb83053adfcffe77a" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2" is_pre_election: true
I20251214 21:03:17.808993 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01da8ce246384c7cb83053adfcffe77a" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4" is_pre_election: true
I20251214 21:03:17.809118 24150 raft_consensus.cc:2468] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.809129 24075 raft_consensus.cc:2468] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 0.
I20251214 21:03:17.809383 23964 leader_election.cc:304] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:17.809558 24208 raft_consensus.cc:2804] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:17.809616 24208 raft_consensus.cc:493] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:17.809654 24208 raft_consensus.cc:3060] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.810492 24208 raft_consensus.cc:515] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.810819 24208 leader_election.cc:290] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Requested vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:17.811251 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01da8ce246384c7cb83053adfcffe77a" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:17.811282 24075 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01da8ce246384c7cb83053adfcffe77a" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:17.811359 24150 raft_consensus.cc:3060] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.811386 24075 raft_consensus.cc:3060] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.812110 24075 raft_consensus.cc:2468] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.812148 24150 raft_consensus.cc:2468] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 1.
I20251214 21:03:17.812364 23965 leader_election.cc:304] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:17.812572 24208 raft_consensus.cc:2804] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:17.812646 24208 raft_consensus.cc:697] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:17.812772 24208 consensus_queue.cc:237] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } }
I20251214 21:03:17.814481 23894 catalog_manager.cc:5654] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:17.832703 24232 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.835525 24075 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:17.836930 24203 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.856935 24208 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.860205 24150 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.862025 24204 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.862211 24148 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.862226 24149 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.862362 24147 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.862757 24150 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.863514 24204 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.863525 23998 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:03:17.863525 24072 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.863647 24073 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.863790 24204 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.863867 23999 raft_consensus.cc:1275] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:03:17.864020 24204 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.864135 24074 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.864248 24204 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.864393 24071 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.864501 24216 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.864631 24147 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:03:17.864737 24216 consensus_queue.cc:1048] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.864996 24150 raft_consensus.cc:1275] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:03:17.872265 24288 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.872611 24288 consensus_queue.cc:1048] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.872972 24285 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.873118 24200 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.873371 24285 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.873402 24200 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.890322 24278 mvcc.cc:204] Tried to move back new op lower bound from 7232496426471284736 to 7232496426242535424. Current Snapshot: MvccSnapshot[applied={T|T < 7232496426433687552}]
I20251214 21:03:17.894433 24072 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.894721 24073 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.895794 23999 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.896102 23997 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.896365 23996 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.896478 24232 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.896613 23995 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.896731 24232 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.897405 24203 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.897665 24203 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.897960 24203 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.898178 24203 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.903748 24071 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.905350 24203 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.905616 24074 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:17.905946 24203 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:17.923724 24317 mvcc.cc:204] Tried to move back new op lower bound from 7232496426583265280 to 7232496424697610240. Current Snapshot: MvccSnapshot[applied={T|T < 7232496426571825152}]
I20251214 21:03:17.939759 24277 mvcc.cc:204] Tried to move back new op lower bound from 7232496426583265280 to 7232496424697610240. Current Snapshot: MvccSnapshot[applied={T|T < 7232496426571825152}]
I20251214 21:03:18.192095 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:18.207897 23996 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:18.208097 23996 raft_consensus.cc:606] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
W20251214 21:03:18.215487 23974 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.215759 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.218552 23972 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.220805 23972 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.222755 23972 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.226503 23974 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.227993 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.228523 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.234640 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.235948 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.238536 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.239454 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.243359 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.244213 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.246232 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
I20251214 21:03:18.250051 24208 raft_consensus.cc:993] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:18.250164 24285 raft_consensus.cc:1081] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
W20251214 21:03:18.250856 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.254424 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.255266 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.260574 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.267802 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.267915 23974 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.268265 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
I20251214 21:03:18.268479 24075 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57968
I20251214 21:03:18.268606 24075 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:18.268662 24075 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:18.270396 24075 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:18.270737 24075 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
W20251214 21:03:18.276717 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.276733 23974 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.277647 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.278295 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
I20251214 21:03:18.280346 24147 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:37144
W20251214 21:03:18.280413 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
I20251214 21:03:18.280462 24147 raft_consensus.cc:606] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
W20251214 21:03:18.280612 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.284375 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
I20251214 21:03:18.284953 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251214 21:03:18.285105 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251214 21:03:18.287935 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.290414 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.290810 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.292418 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
W20251214 21:03:18.293138 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Service unavailable: leader transfer in progress
I20251214 21:03:18.293857 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:18.293967 24145 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
W20251214 21:03:18.294394 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
I20251214 21:03:18.294987 24145 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:18.296592 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:18.296788 23997 raft_consensus.cc:3055] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:18.296976 23997 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:18.297207 23997 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:18.297569 23997 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
W20251214 21:03:18.298266 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
I20251214 21:03:18.299214 23997 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:18.303977 24039 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:18.304211 24280 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:18.304301 24280 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:18.304435 24280 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
W20251214 21:03:18.306478 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Illegal state: replica 126ee409f2314ba091e87159b26c0c62 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.306717 23973 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Illegal state: replica 126ee409f2314ba091e87159b26c0c62 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.307066 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Illegal state: replica 126ee409f2314ba091e87159b26c0c62 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.307874 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Illegal state: replica 126ee409f2314ba091e87159b26c0c62 is not leader of this config: current role FOLLOWER
I20251214 21:03:18.309248 23887 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 1 to 2, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
W20251214 21:03:18.311224 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
I20251214 21:03:18.319397 23997 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 2 index: 18. (index mismatch)
I20251214 21:03:18.319480 24150 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 2 index: 18. (index mismatch)
I20251214 21:03:18.319698 24216 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20251214 21:03:18.319777 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
I20251214 21:03:18.319952 24216 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20251214 21:03:18.331799 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.335000 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.342934 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.343484 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.349016 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.352303 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.358598 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.359127 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.362128 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.362632 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.363663 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.367731 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.369150 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.379555 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.380955 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.381527 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.381989 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.390113 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.390836 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.392732 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.396620 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.397317 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.399271 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.401111 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.406172 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.408171 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.411175 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.411942 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.417019 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.421010 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.421118 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.426185 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.426199 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.432358 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.435333 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.435391 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.441428 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.445431 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.446183 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.451321 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.458475 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.458503 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.460490 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.463403 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.473747 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.475869 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.478895 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.479642 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.490926 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.491005 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.495116 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.495956 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.509164 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.509191 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.512297 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.515349 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.526643 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.528766 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.528851 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.539314 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.545619 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.549038 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.549038 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.564608 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.566623 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.566686 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.567397 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.586776 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.586803 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.586803 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.587678 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.610114 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.611086 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.611141 24122 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.611282 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.632651 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.633536 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.634286 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.638393 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.655862 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.656724 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.660785 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.664929 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.683395 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.683387 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.686580 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.692638 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.708165 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.711673 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.714910 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.719215 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.737924 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.737946 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.742254 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.749408 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.765641 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.767712 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.768512 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.778782 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.793066 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.797322 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.798296 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.808548 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.821780 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.826956 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.828971 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.840226 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.852489 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.857750 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.858682 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.871964 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.886307 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.892573 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
W20251214 21:03:18.892573 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Service unavailable: leader transfer in progress
I20251214 21:03:18.893189 24203 raft_consensus.cc:993] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:18.893260 24203 raft_consensus.cc:1081] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:18.893651 24068 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57956
I20251214 21:03:18.893795 24068 raft_consensus.cc:493] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:18.893865 24068 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:18.894670 24068 raft_consensus.cc:515] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:18.894982 24068 leader_election.cc:290] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:18.895267 23998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:18.895357 23998 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:18.896129 23998 raft_consensus.cc:2468] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:18.896327 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:18.896405 24145 raft_consensus.cc:3055] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:18.896409 24039 leader_election.cc:304] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:18.896477 24145 raft_consensus.cc:740] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:18.896625 24284 raft_consensus.cc:2804] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:18.896636 24145 consensus_queue.cc:260] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 23, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:18.896788 24284 raft_consensus.cc:697] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:18.896827 24145 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:18.896926 24284 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 23, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:18.897629 24145 raft_consensus.cc:2468] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:18.898429 23887 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 1 to 2, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
W20251214 21:03:18.904966 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Illegal state: replica fe19ae24b84b428e8559931c04f1a6b2 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.919416 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Illegal state: replica fe19ae24b84b428e8559931c04f1a6b2 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.926542 24123 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Illegal state: replica fe19ae24b84b428e8559931c04f1a6b2 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.926606 24121 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37136: Illegal state: replica fe19ae24b84b428e8559931c04f1a6b2 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.939152 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Illegal state: replica 126ee409f2314ba091e87159b26c0c62 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.953442 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Illegal state: replica 126ee409f2314ba091e87159b26c0c62 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.962604 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Illegal state: replica 126ee409f2314ba091e87159b26c0c62 is not leader of this config: current role FOLLOWER
W20251214 21:03:18.963562 23971 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50514: Illegal state: replica 126ee409f2314ba091e87159b26c0c62 is not leader of this config: current role FOLLOWER
I20251214 21:03:18.977360 24145 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 2 index: 25. (index mismatch)
I20251214 21:03:18.977360 23998 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 2 index: 25. (index mismatch)
I20251214 21:03:18.977810 24284 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20251214 21:03:18.977932 24338 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20251214 21:03:19.004025 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:19.005827 24350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:19.005882 20608 server_base.cc:1047] running on GCE node
W20251214 21:03:19.005861 24349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:19.006173 24352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:19.006377 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:19.006421 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:19.006441 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746199006441 us; error 0 us; skew 500 ppm
I20251214 21:03:19.007323 20608 webserver.cc:492] Webserver started at http://127.20.32.4:39513/ using document root <none> and password file <none>
I20251214 21:03:19.007453 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:19.007500 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:19.007570 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:19.007920 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-3-root/instance:
uuid: "f0fd707333e94628b613b5d3387fc999"
format_stamp: "Formatted at 2025-12-14 21:03:19 on dist-test-slave-bphs"
I20251214 21:03:19.009439 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:19.011307 24357 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.011749 20608 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:19.011833 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-3-root
uuid: "f0fd707333e94628b613b5d3387fc999"
format_stamp: "Formatted at 2025-12-14 21:03:19 on dist-test-slave-bphs"
I20251214 21:03:19.011921 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:19.024049 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:19.024435 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:19.024703 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:19.025162 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:19.025200 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.025240 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:19.025266 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.029621 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.4:40145
I20251214 21:03:19.029695 24420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.4:40145 every 8 connection(s)
I20251214 21:03:19.030465 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:19.032301 24425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:19.032418 24428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:19.032473 24426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:19.033315 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:19.033493 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:19.033536 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:19.033560 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746199033558 us; error 0 us; skew 500 ppm
I20251214 21:03:19.034559 20608 webserver.cc:492] Webserver started at http://127.20.32.5:33349/ using document root <none> and password file <none>
I20251214 21:03:19.034718 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:19.034773 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:19.034844 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:19.035115 24421 heartbeater.cc:344] Connected to a master server at 127.20.32.62:36169
I20251214 21:03:19.035207 24421 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:19.035277 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-4-root/instance:
uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
format_stamp: "Formatted at 2025-12-14 21:03:19 on dist-test-slave-bphs"
I20251214 21:03:19.035449 24421 heartbeater.cc:507] Master 127.20.32.62:36169 requested a full tablet report, sending...
I20251214 21:03:19.036083 23896 ts_manager.cc:194] Registered new tserver with Master: f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145)
I20251214 21:03:19.036739 23896 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55150
I20251214 21:03:19.037025 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:03:19.038173 24433 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.038460 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:19.038522 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-4-root
uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
format_stamp: "Formatted at 2025-12-14 21:03:19 on dist-test-slave-bphs"
I20251214 21:03:19.038581 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-4-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-4-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-4-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:19.052134 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:19.052537 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:19.052839 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:19.053300 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:19.053341 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.053382 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:19.053411 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.058208 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.5:46823
I20251214 21:03:19.058331 24496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.5:46823 every 8 connection(s)
I20251214 21:03:19.059196 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:19.061110 24500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:19.061123 24501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:19.061204 24503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:19.061374 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:19.061529 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:19.061571 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:19.061599 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746199061597 us; error 0 us; skew 500 ppm
I20251214 21:03:19.062570 20608 webserver.cc:492] Webserver started at http://127.20.32.6:45009/ using document root <none> and password file <none>
I20251214 21:03:19.062711 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:19.062763 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:19.062827 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:19.063243 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-5-root/instance:
uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
format_stamp: "Formatted at 2025-12-14 21:03:19 on dist-test-slave-bphs"
I20251214 21:03:19.063266 24497 heartbeater.cc:344] Connected to a master server at 127.20.32.62:36169
I20251214 21:03:19.063371 24497 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:19.063567 24497 heartbeater.cc:507] Master 127.20.32.62:36169 requested a full tablet report, sending...
I20251214 21:03:19.064126 23896 ts_manager.cc:194] Registered new tserver with Master: b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823)
I20251214 21:03:19.064744 23896 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55152
I20251214 21:03:19.065160 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:03:19.066191 24508 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.066462 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:19.066524 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-5-root
uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
format_stamp: "Formatted at 2025-12-14 21:03:19 on dist-test-slave-bphs"
I20251214 21:03:19.066592 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-5-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-5-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-5-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:19.090610 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:19.091075 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:19.091377 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:19.091890 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:19.091931 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.091964 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:19.091991 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:19.096359 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.6:36351
I20251214 21:03:19.096513 24571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.6:36351 every 8 connection(s)
I20251214 21:03:19.100934 24572 heartbeater.cc:344] Connected to a master server at 127.20.32.62:36169
I20251214 21:03:19.101028 24572 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:19.101239 24572 heartbeater.cc:507] Master 127.20.32.62:36169 requested a full tablet report, sending...
I20251214 21:03:19.101964 23896 ts_manager.cc:194] Registered new tserver with Master: a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:19.102499 23896 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55168
I20251214 21:03:19.201098 23998 consensus_queue.cc:237] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:19.202605 24068 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.202606 24145 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.203001 24577 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.203297 24335 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.204480 24577 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:19.204909 24145 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:19.204936 24068 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:19.207300 23896 catalog_manager.cc:5654] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index -1 to 28, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
W20251214 21:03:19.208500 23965 consensus_peers.cc:597] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14f65411fb9c45b0892ef02beae5b884. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:19.211266 24145 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:19.212637 24068 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.212745 23998 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.213039 24581 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.213253 24337 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.214637 24203 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:19.215042 23998 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:19.217022 23889 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index -1 to 28, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:03:19.218178 24114 consensus_peers.cc:597] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 -> Peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145): Couldn't send request to peer f0fd707333e94628b613b5d3387fc999. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f19d4d6bfd10472094bb7a6f81cd06b4. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:19.218127 24068 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:19.221133 24068 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 2.28, Last appended by leader: 23, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:19.222358 24145 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251214 21:03:19.222666 24284 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:19.222790 23998 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251214 21:03:19.223179 24284 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:19.224327 24345 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.29: config changed from index -1 to 29, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:19.224849 23998 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.29: config changed from index -1 to 29, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:19.226431 24150 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.29: config changed from index -1 to 29, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:19.226622 23998 consensus_queue.cc:237] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
W20251214 21:03:19.227098 24038 consensus_peers.cc:597] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 -> Peer b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823): Couldn't send request to peer b4706a6e7f19453ebb19fbfb8ef7558b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c649579f0f94f23aca3eafa7d81df2e. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:19.227754 24150 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
W20251214 21:03:19.228050 23965 consensus_peers.cc:597] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 445f6b3b3b63458abdaa3054956e957b. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:19.228096 24577 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.228386 24068 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.228470 23887 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index -1 to 29, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:19.229051 24577 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.229676 24335 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:19.230459 24150 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:19.231268 24068 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:19.232486 24145 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:19.232479 23896 catalog_manager.cc:5654] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index -1 to 28, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:19.234052 24068 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.234393 24581 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.235978 23998 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.236075 24203 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:19.236472 24068 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:19.237553 24203 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.238783 23997 consensus_queue.cc:237] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:19.238946 23889 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:03:19.240453 24113 consensus_peers.cc:597] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 -> Peer b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823): Couldn't send request to peer b4706a6e7f19453ebb19fbfb8ef7558b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f498cd6fedac4052b7593b1dda35af6a. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:19.241123 24150 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.241655 24335 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.242566 23998 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:19.243592 24335 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
W20251214 21:03:19.244639 23963 consensus_peers.cc:597] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 -> Peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145): Couldn't send request to peer f0fd707333e94628b613b5d3387fc999. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01da8ce246384c7cb83053adfcffe77a. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:19.244745 24150 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:19.245859 24068 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:19.246306 24285 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:19.247076 23887 catalog_manager.cc:5654] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index -1 to 28, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:19.247810 24068 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:19.598788 24587 ts_tablet_manager.cc:933] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: Initiating tablet copy from peer fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:19.599128 24587 tablet_copy_client.cc:323] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:32947
I20251214 21:03:19.602674 24160 tablet_copy_service.cc:140] P fe19ae24b84b428e8559931c04f1a6b2: Received BeginTabletCopySession request for tablet f19d4d6bfd10472094bb7a6f81cd06b4 from peer f0fd707333e94628b613b5d3387fc999 ({username='slave'} at 127.0.0.1:37170)
I20251214 21:03:19.602793 24160 tablet_copy_service.cc:161] P fe19ae24b84b428e8559931c04f1a6b2: Beginning new tablet copy session on tablet f19d4d6bfd10472094bb7a6f81cd06b4 from peer f0fd707333e94628b613b5d3387fc999 at {username='slave'} at 127.0.0.1:37170: session id = f0fd707333e94628b613b5d3387fc999-f19d4d6bfd10472094bb7a6f81cd06b4
I20251214 21:03:19.603839 24160 tablet_copy_source_session.cc:215] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:19.604664 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19d4d6bfd10472094bb7a6f81cd06b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:19.606813 24587 tablet_copy_client.cc:806] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:19.606974 24587 tablet_copy_client.cc:670] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:19.607973 24588 tablet_copy_client.cc:1025] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:19.638638 24590 ts_tablet_manager.cc:933] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: Initiating tablet copy from peer fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:19.638976 24590 tablet_copy_client.cc:323] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:32947
I20251214 21:03:19.642724 24160 tablet_copy_service.cc:140] P fe19ae24b84b428e8559931c04f1a6b2: Received BeginTabletCopySession request for tablet f498cd6fedac4052b7593b1dda35af6a from peer b4706a6e7f19453ebb19fbfb8ef7558b ({username='slave'} at 127.0.0.1:37180)
I20251214 21:03:19.642825 24160 tablet_copy_service.cc:161] P fe19ae24b84b428e8559931c04f1a6b2: Beginning new tablet copy session on tablet f498cd6fedac4052b7593b1dda35af6a from peer b4706a6e7f19453ebb19fbfb8ef7558b at {username='slave'} at 127.0.0.1:37180: session id = b4706a6e7f19453ebb19fbfb8ef7558b-f498cd6fedac4052b7593b1dda35af6a
I20251214 21:03:19.643731 24160 tablet_copy_source_session.cc:215] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:19.644526 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f498cd6fedac4052b7593b1dda35af6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:19.646641 24590 tablet_copy_client.cc:806] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:19.646894 24590 tablet_copy_client.cc:670] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:19.647809 24591 tablet_copy_client.cc:1025] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:19.688534 24593 ts_tablet_manager.cc:933] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: Initiating tablet copy from peer 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681)
I20251214 21:03:19.688927 24593 tablet_copy_client.cc:323] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.1:39681
I20251214 21:03:19.692607 24009 tablet_copy_service.cc:140] P 126ee409f2314ba091e87159b26c0c62: Received BeginTabletCopySession request for tablet 14f65411fb9c45b0892ef02beae5b884 from peer a52fd6dfbfc440b19b28bcd675e1d210 ({username='slave'} at 127.0.0.1:50536)
I20251214 21:03:19.692715 24009 tablet_copy_service.cc:161] P 126ee409f2314ba091e87159b26c0c62: Beginning new tablet copy session on tablet 14f65411fb9c45b0892ef02beae5b884 from peer a52fd6dfbfc440b19b28bcd675e1d210 at {username='slave'} at 127.0.0.1:50536: session id = a52fd6dfbfc440b19b28bcd675e1d210-14f65411fb9c45b0892ef02beae5b884
I20251214 21:03:19.693558 24009 tablet_copy_source_session.cc:215] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:19.694334 24593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f65411fb9c45b0892ef02beae5b884. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:19.696271 24593 tablet_copy_client.cc:806] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:19.696420 24593 tablet_copy_client.cc:670] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:19.697594 24594 tablet_copy_client.cc:1025] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:19.761019 24596 ts_tablet_manager.cc:933] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: Initiating tablet copy from peer 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:19.761260 24597 ts_tablet_manager.cc:933] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: Initiating tablet copy from peer 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681)
I20251214 21:03:19.761394 24596 tablet_copy_client.cc:323] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:36087
I20251214 21:03:19.761472 24597 tablet_copy_client.cc:323] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.1:39681
I20251214 21:03:19.764966 24009 tablet_copy_service.cc:140] P 126ee409f2314ba091e87159b26c0c62: Received BeginTabletCopySession request for tablet 01da8ce246384c7cb83053adfcffe77a from peer f0fd707333e94628b613b5d3387fc999 ({username='slave'} at 127.0.0.1:50550)
I20251214 21:03:19.765075 24009 tablet_copy_service.cc:161] P 126ee409f2314ba091e87159b26c0c62: Beginning new tablet copy session on tablet 01da8ce246384c7cb83053adfcffe77a from peer f0fd707333e94628b613b5d3387fc999 at {username='slave'} at 127.0.0.1:50550: session id = f0fd707333e94628b613b5d3387fc999-01da8ce246384c7cb83053adfcffe77a
I20251214 21:03:19.765259 24085 tablet_copy_service.cc:140] P 68bf8595326044d78e9d47fe858479d4: Received BeginTabletCopySession request for tablet 4c649579f0f94f23aca3eafa7d81df2e from peer b4706a6e7f19453ebb19fbfb8ef7558b ({username='slave'} at 127.0.0.1:58000)
I20251214 21:03:19.765352 24085 tablet_copy_service.cc:161] P 68bf8595326044d78e9d47fe858479d4: Beginning new tablet copy session on tablet 4c649579f0f94f23aca3eafa7d81df2e from peer b4706a6e7f19453ebb19fbfb8ef7558b at {username='slave'} at 127.0.0.1:58000: session id = b4706a6e7f19453ebb19fbfb8ef7558b-4c649579f0f94f23aca3eafa7d81df2e
I20251214 21:03:19.765973 24009 tablet_copy_source_session.cc:215] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:19.766047 24085 tablet_copy_source_session.cc:215] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:19.766717 24596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c649579f0f94f23aca3eafa7d81df2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:19.766716 24597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01da8ce246384c7cb83053adfcffe77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:19.768854 24597 tablet_copy_client.cc:806] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:19.768865 24596 tablet_copy_client.cc:806] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:19.769018 24597 tablet_copy_client.cc:670] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:19.769133 24596 tablet_copy_client.cc:670] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:19.770018 24598 tablet_copy_client.cc:1025] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:19.770117 24599 tablet_copy_client.cc:1025] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:19.838521 24602 ts_tablet_manager.cc:933] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: Initiating tablet copy from peer 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681)
I20251214 21:03:19.838925 24602 tablet_copy_client.cc:323] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.1:39681
I20251214 21:03:19.839277 24009 tablet_copy_service.cc:140] P 126ee409f2314ba091e87159b26c0c62: Received BeginTabletCopySession request for tablet 445f6b3b3b63458abdaa3054956e957b from peer a52fd6dfbfc440b19b28bcd675e1d210 ({username='slave'} at 127.0.0.1:50536)
I20251214 21:03:19.839367 24009 tablet_copy_service.cc:161] P 126ee409f2314ba091e87159b26c0c62: Beginning new tablet copy session on tablet 445f6b3b3b63458abdaa3054956e957b from peer a52fd6dfbfc440b19b28bcd675e1d210 at {username='slave'} at 127.0.0.1:50536: session id = a52fd6dfbfc440b19b28bcd675e1d210-445f6b3b3b63458abdaa3054956e957b
I20251214 21:03:19.840211 24009 tablet_copy_source_session.cc:215] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:19.840898 24602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f6b3b3b63458abdaa3054956e957b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:19.842958 24602 tablet_copy_client.cc:806] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:19.843115 24602 tablet_copy_client.cc:670] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:19.844017 24603 tablet_copy_client.cc:1025] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:20.037607 24421 heartbeater.cc:499] Master 127.20.32.62:36169 was elected leader, sending a full tablet report...
I20251214 21:03:20.065564 24497 heartbeater.cc:499] Master 127.20.32.62:36169 was elected leader, sending a full tablet report...
I20251214 21:03:20.103307 24572 heartbeater.cc:499] Master 127.20.32.62:36169 was elected leader, sending a full tablet report...
I20251214 21:03:20.285502 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:20.287144 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:20.287312 23997 raft_consensus.cc:606] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:20.288072 24150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:37144
I20251214 21:03:20.288193 24150 raft_consensus.cc:606] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:20.288445 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251214 21:03:20.288668 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:20.493099 24203 raft_consensus.cc:993] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:20.493245 24337 raft_consensus.cc:1081] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:20.493633 23998 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50490
I20251214 21:03:20.493781 23998 raft_consensus.cc:493] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:20.493844 23998 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:20.494856 23998 raft_consensus.cc:515] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:20.495257 23998 leader_election.cc:290] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 2 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:20.495528 24072 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:20.495633 24072 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:20.496461 24072 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 2.
I20251214 21:03:20.496740 23965 leader_election.cc:304] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:20.496953 24604 raft_consensus.cc:2804] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:20.497042 24604 raft_consensus.cc:697] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:20.497179 24604 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:20.496762 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:20.497931 24150 raft_consensus.cc:3055] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:20.497978 24150 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:20.498109 24150 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:20.498291 24150 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:20.499091 24150 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 2.
I20251214 21:03:20.499889 23887 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 1 to 2, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 2 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:20.686841 24601 raft_consensus.cc:993] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:20.686980 24601 raft_consensus.cc:1081] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:20.687397 24072 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57968
I20251214 21:03:20.687542 24072 raft_consensus.cc:493] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:20.687606 24072 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:20.688759 24072 raft_consensus.cc:515] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:20.689152 24072 leader_election.cc:290] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:20.689419 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:20.689489 23998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:20.689553 24150 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:20.689584 23998 raft_consensus.cc:3055] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:20.689623 23998 raft_consensus.cc:740] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:20.689800 23998 consensus_queue.cc:260] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:20.689989 23998 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:20.690714 24150 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:20.690882 23998 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:20.691020 24040 leader_election.cc:304] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:20.691185 24284 raft_consensus.cc:2804] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:20.691288 24284 raft_consensus.cc:697] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:20.691418 24284 consensus_queue.cc:237] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:20.693096 23887 catalog_manager.cc:5654] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 1 to 2, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:03:20.918875 23963 consensus_peers.cc:597] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 -> Peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145): Couldn't send request to peer f0fd707333e94628b613b5d3387fc999. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:20.991355 24072 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251214 21:03:20.991590 24150 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251214 21:03:20.991963 24604 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:20.992121 24335 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
W20251214 21:03:21.134506 24041 consensus_peers.cc:597] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:21.172488 23997 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251214 21:03:21.172957 24613 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:21.176529 24150 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251214 21:03:21.177104 24613 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:21.608404 24587 tablet_copy_client.cc:538] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:21.609995 24587 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: Bootstrap starting.
I20251214 21:03:21.635633 24587 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: Bootstrap replayed 1/1 log segments. Stats: ops{read=28 overwritten=0 applied=28 ignored=0} inserts{seen=116 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:21.635914 24587 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: Bootstrap complete.
I20251214 21:03:21.636101 24587 ts_tablet_manager.cc:1403] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: Time spent bootstrapping tablet: real 0.026s user 0.024s sys 0.000s
I20251214 21:03:21.636591 24587 raft_consensus.cc:359] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:21.636718 24587 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f0fd707333e94628b613b5d3387fc999, State: Initialized, Role: LEARNER
I20251214 21:03:21.636818 24587 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:21.637156 24587 ts_tablet_manager.cc:1434] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:03:21.637653 24160 tablet_copy_service.cc:342] P fe19ae24b84b428e8559931c04f1a6b2: Request end of tablet copy session f0fd707333e94628b613b5d3387fc999-f19d4d6bfd10472094bb7a6f81cd06b4 received from {username='slave'} at 127.0.0.1:37170
I20251214 21:03:21.637770 24160 tablet_copy_service.cc:434] P fe19ae24b84b428e8559931c04f1a6b2: ending tablet copy session f0fd707333e94628b613b5d3387fc999-f19d4d6bfd10472094bb7a6f81cd06b4 on tablet f19d4d6bfd10472094bb7a6f81cd06b4 with peer f0fd707333e94628b613b5d3387fc999
I20251214 21:03:21.648222 24590 tablet_copy_client.cc:538] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:21.649804 24590 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap starting.
I20251214 21:03:21.673692 24590 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap replayed 1/1 log segments. Stats: ops{read=28 overwritten=0 applied=28 ignored=0} inserts{seen=125 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:21.674012 24590 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap complete.
I20251214 21:03:21.674199 24590 ts_tablet_manager.cc:1403] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent bootstrapping tablet: real 0.024s user 0.020s sys 0.004s
I20251214 21:03:21.674683 24590 raft_consensus.cc:359] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:21.674796 24590 raft_consensus.cc:740] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b4706a6e7f19453ebb19fbfb8ef7558b, State: Initialized, Role: LEARNER
I20251214 21:03:21.674914 24590 consensus_queue.cc:260] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:21.675261 24590 ts_tablet_manager.cc:1434] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:21.675721 24160 tablet_copy_service.cc:342] P fe19ae24b84b428e8559931c04f1a6b2: Request end of tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-f498cd6fedac4052b7593b1dda35af6a received from {username='slave'} at 127.0.0.1:37180
I20251214 21:03:21.675796 24160 tablet_copy_service.cc:434] P fe19ae24b84b428e8559931c04f1a6b2: ending tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-f498cd6fedac4052b7593b1dda35af6a on tablet f498cd6fedac4052b7593b1dda35af6a with peer b4706a6e7f19453ebb19fbfb8ef7558b
I20251214 21:03:21.698174 24593 tablet_copy_client.cc:538] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:21.699754 24593 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap starting.
I20251214 21:03:21.723119 24593 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap replayed 1/1 log segments. Stats: ops{read=28 overwritten=0 applied=28 ignored=0} inserts{seen=94 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:21.723412 24593 tablet_bootstrap.cc:492] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap complete.
I20251214 21:03:21.723613 24593 ts_tablet_manager.cc:1403] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: Time spent bootstrapping tablet: real 0.024s user 0.023s sys 0.000s
I20251214 21:03:21.724093 24593 raft_consensus.cc:359] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:21.724225 24593 raft_consensus.cc:740] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a52fd6dfbfc440b19b28bcd675e1d210, State: Initialized, Role: LEARNER
I20251214 21:03:21.724335 24593 consensus_queue.cc:260] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:21.724675 24593 ts_tablet_manager.cc:1434] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:03:21.725085 24009 tablet_copy_service.cc:342] P 126ee409f2314ba091e87159b26c0c62: Request end of tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-14f65411fb9c45b0892ef02beae5b884 received from {username='slave'} at 127.0.0.1:50536
I20251214 21:03:21.725173 24009 tablet_copy_service.cc:434] P 126ee409f2314ba091e87159b26c0c62: ending tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-14f65411fb9c45b0892ef02beae5b884 on tablet 14f65411fb9c45b0892ef02beae5b884 with peer a52fd6dfbfc440b19b28bcd675e1d210
I20251214 21:03:21.770465 24596 tablet_copy_client.cc:538] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:21.772032 24596 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap starting.
I20251214 21:03:21.772101 24597 tablet_copy_client.cc:538] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:21.773484 24597 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: Bootstrap starting.
I20251214 21:03:21.795181 24597 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: Bootstrap replayed 1/1 log segments. Stats: ops{read=28 overwritten=0 applied=28 ignored=0} inserts{seen=122 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:21.795475 24597 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: Bootstrap complete.
I20251214 21:03:21.795651 24597 ts_tablet_manager.cc:1403] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.000s
I20251214 21:03:21.796077 24597 raft_consensus.cc:359] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:21.796185 24597 raft_consensus.cc:740] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f0fd707333e94628b613b5d3387fc999, State: Initialized, Role: LEARNER
I20251214 21:03:21.796305 24597 consensus_queue.cc:260] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:21.796643 24597 ts_tablet_manager.cc:1434] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:03:21.797035 24009 tablet_copy_service.cc:342] P 126ee409f2314ba091e87159b26c0c62: Request end of tablet copy session f0fd707333e94628b613b5d3387fc999-01da8ce246384c7cb83053adfcffe77a received from {username='slave'} at 127.0.0.1:50550
I20251214 21:03:21.797112 24009 tablet_copy_service.cc:434] P 126ee409f2314ba091e87159b26c0c62: ending tablet copy session f0fd707333e94628b613b5d3387fc999-01da8ce246384c7cb83053adfcffe77a on tablet 01da8ce246384c7cb83053adfcffe77a with peer f0fd707333e94628b613b5d3387fc999
I20251214 21:03:21.798386 24596 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap replayed 1/1 log segments. Stats: ops{read=29 overwritten=0 applied=29 ignored=0} inserts{seen=109 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:21.798653 24596 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap complete.
I20251214 21:03:21.798843 24596 ts_tablet_manager.cc:1403] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent bootstrapping tablet: real 0.027s user 0.026s sys 0.000s
I20251214 21:03:21.799304 24596 raft_consensus.cc:359] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:21.799407 24596 raft_consensus.cc:740] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b4706a6e7f19453ebb19fbfb8ef7558b, State: Initialized, Role: LEARNER
I20251214 21:03:21.799500 24596 consensus_queue.cc:260] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:21.799752 24596 ts_tablet_manager.cc:1434] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:21.800344 24085 tablet_copy_service.cc:342] P 68bf8595326044d78e9d47fe858479d4: Request end of tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-4c649579f0f94f23aca3eafa7d81df2e received from {username='slave'} at 127.0.0.1:58000
I20251214 21:03:21.800415 24085 tablet_copy_service.cc:434] P 68bf8595326044d78e9d47fe858479d4: ending tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-4c649579f0f94f23aca3eafa7d81df2e on tablet 4c649579f0f94f23aca3eafa7d81df2e with peer b4706a6e7f19453ebb19fbfb8ef7558b
I20251214 21:03:21.844457 24602 tablet_copy_client.cc:538] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:21.845954 24602 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap starting.
I20251214 21:03:21.866765 24602 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap replayed 1/1 log segments. Stats: ops{read=28 overwritten=0 applied=28 ignored=0} inserts{seen=113 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:21.867091 24602 tablet_bootstrap.cc:492] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap complete.
I20251214 21:03:21.867308 24602 ts_tablet_manager.cc:1403] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.005s
I20251214 21:03:21.867731 24602 raft_consensus.cc:359] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:21.867837 24602 raft_consensus.cc:740] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a52fd6dfbfc440b19b28bcd675e1d210, State: Initialized, Role: LEARNER
I20251214 21:03:21.867918 24602 consensus_queue.cc:260] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:21.868146 24602 ts_tablet_manager.cc:1434] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:21.868636 24009 tablet_copy_service.cc:342] P 126ee409f2314ba091e87159b26c0c62: Request end of tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-445f6b3b3b63458abdaa3054956e957b received from {username='slave'} at 127.0.0.1:50536
I20251214 21:03:21.868718 24009 tablet_copy_service.cc:434] P 126ee409f2314ba091e87159b26c0c62: ending tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-445f6b3b3b63458abdaa3054956e957b on tablet 445f6b3b3b63458abdaa3054956e957b with peer a52fd6dfbfc440b19b28bcd675e1d210
I20251214 21:03:21.906531 24395 raft_consensus.cc:1217] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.27->[1.28-1.28] Dedup: 1.28->[]
I20251214 21:03:21.925388 24395 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Advancing to term 2
I20251214 21:03:22.159403 24471 raft_consensus.cc:1217] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.27->[1.28-1.28] Dedup: 1.28->[]
I20251214 21:03:22.175585 24546 raft_consensus.cc:1217] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.27->[1.28-1.28] Dedup: 1.28->[]
I20251214 21:03:22.176083 24546 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 LEARNER]: Advancing to term 2
I20251214 21:03:22.217105 24471 raft_consensus.cc:1217] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.28->[2.29-2.29] Dedup: 2.29->[]
I20251214 21:03:22.288935 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:22.290688 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:22.290860 23997 raft_consensus.cc:606] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Received request to transfer leadership to TS fe19ae24b84b428e8559931c04f1a6b2
I20251214 21:03:22.291194 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:22.291312 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:22.375015 24627 raft_consensus.cc:1064] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
I20251214 21:03:22.375450 24627 consensus_queue.cc:237] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:22.376596 24068 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.376637 24395 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.376958 24150 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.377025 24641 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.377275 24639 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.377415 24638 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.379164 24638 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:22.379880 24068 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:22.381841 24395 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:22.381841 24150 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:22.382226 23887 catalog_manager.cc:5654] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 28 to 29, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:22.386538 23998 consensus_queue.cc:237] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:22.387593 24395 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:22.387964 24641 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.388283 24150 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:22.388927 24641 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.389605 24639 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:22.390621 24150 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:22.391273 23881 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 01da8ce246384c7cb83053adfcffe77a with cas_config_opid_index 29: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:22.391595 24395 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:22.392848 23889 catalog_manager.cc:5654] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index 29 to 30, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:22.395154 24056 tablet_service.cc:1552] Processing DeleteTablet for tablet 01da8ce246384c7cb83053adfcffe77a with delete_type TABLET_DATA_TOMBSTONED (TS 68bf8595326044d78e9d47fe858479d4 not found in new config with opid_index 30) from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:22.395512 24649 tablet_replica.cc:333] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:22.395651 24649 raft_consensus.cc:2243] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:22.395784 24649 raft_consensus.cc:2272] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:22.396742 24649 ts_tablet_manager.cc:1916] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:22.398746 24649 ts_tablet_manager.cc:1929] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.29
I20251214 21:03:22.398838 24649 log.cc:1199] T 01da8ce246384c7cb83053adfcffe77a P 68bf8595326044d78e9d47fe858479d4: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/01da8ce246384c7cb83053adfcffe77a
I20251214 21:03:22.399307 23883 catalog_manager.cc:4985] TS 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): tablet 01da8ce246384c7cb83053adfcffe77a (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:22.411741 24627 raft_consensus.cc:1064] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
W20251214 21:03:22.411857 24627 raft_consensus.cc:1067] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: Unable to promote non-voter f0fd707333e94628b613b5d3387fc999: Service unavailable: leader transfer in progress
I20251214 21:03:22.530315 24638 raft_consensus.cc:993] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:22.530436 24638 raft_consensus.cc:1081] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Signalling peer fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:22.530820 24150 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:37122
I20251214 21:03:22.530963 24150 raft_consensus.cc:493] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:22.531024 24150 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:22.532002 24150 raft_consensus.cc:515] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:22.532383 24150 leader_election.cc:290] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 3 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:22.532656 24072 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 29 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:22.532761 24072 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:22.532817 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 29 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:22.532923 23997 raft_consensus.cc:3055] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:22.532974 23997 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:22.533106 23997 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:22.533279 23997 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:22.533812 24072 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 3.
I20251214 21:03:22.534097 24116 leader_election.cc:304] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:22.534165 23997 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 3.
I20251214 21:03:22.534267 24611 raft_consensus.cc:2804] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:22.534441 24611 raft_consensus.cc:697] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:22.534569 24611 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:22.536108 23896 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 2 to 3, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 3 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:22.661655 24652 raft_consensus.cc:1064] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: attempting to promote NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b to VOTER
I20251214 21:03:22.662151 24652 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 23, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:22.663589 24471 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:22.663777 23998 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:22.663971 24654 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.664172 24150 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:22.664215 24632 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.664436 24654 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.666674 24654 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.30: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.667061 24150 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.668861 24471 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.669981 23997 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.670423 23894 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:22.672237 24650 raft_consensus.cc:1064] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: attempting to promote NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b to VOTER
I20251214 21:03:22.672614 24650 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:22.674247 24470 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.674896 24068 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 2.30, Last appended by leader: 23, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:22.675155 23997 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.675401 24661 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.675675 24611 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.676381 24150 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:22.676960 24068 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.677109 24632 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:22.677989 24650 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.678858 24654 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.679000 24469 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:22.679149 24150 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.679937 24632 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:22.680140 24650 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.681337 23889 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index 30 to 31, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:22.681377 23883 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4c649579f0f94f23aca3eafa7d81df2e with cas_config_opid_index 30: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:22.681900 24471 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.681927 24469 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.683887 23998 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.685627 23989 tablet_service.cc:1552] Processing DeleteTablet for tablet 4c649579f0f94f23aca3eafa7d81df2e with delete_type TABLET_DATA_TOMBSTONED (TS 126ee409f2314ba091e87159b26c0c62 not found in new config with opid_index 31) from {username='slave'} at 127.0.0.1:50476
I20251214 21:03:22.686216 24068 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.686430 24666 tablet_replica.cc:333] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:22.686554 24666 raft_consensus.cc:2243] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:22.686679 24666 raft_consensus.cc:2272] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:22.686879 24652 raft_consensus.cc:1064] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4: attempting to promote NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 to VOTER
I20251214 21:03:22.687278 24652 consensus_queue.cc:237] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 28, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:22.687287 24666 ts_tablet_manager.cc:1916] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:22.687651 23887 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.688544 23998 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:22.688823 24150 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:22.688875 24658 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.688966 24546 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEARNER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:22.689113 24632 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.689673 24658 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.690359 24666 ts_tablet_manager.cc:1929] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.30
I20251214 21:03:22.690421 24666 log.cc:1199] T 4c649579f0f94f23aca3eafa7d81df2e P 126ee409f2314ba091e87159b26c0c62: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/4c649579f0f94f23aca3eafa7d81df2e
I20251214 21:03:22.690932 23881 catalog_manager.cc:4985] TS 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681): tablet 4c649579f0f94f23aca3eafa7d81df2e (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:22.692582 24150 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:22.692588 24632 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.30: config changed from index 28 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.693607 24469 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:22.694049 24068 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:22.694357 24661 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.694315 24546 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 28 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.694640 24661 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.695802 23998 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 28 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.695885 24145 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 28 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.696004 23896 catalog_manager.cc:5654] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index 28 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:22.698724 24650 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.699011 24469 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.700022 23882 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet f498cd6fedac4052b7593b1dda35af6a with cas_config_opid_index 29: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:22.701232 23894 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: config changed from index 29 to 30, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.702100 24072 consensus_queue.cc:237] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 2.30, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:22.703080 23998 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:22.703351 24654 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:22.703563 24072 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:22.704846 24658 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.705147 23989 tablet_service.cc:1552] Processing DeleteTablet for tablet f498cd6fedac4052b7593b1dda35af6a with delete_type TABLET_DATA_TOMBSTONED (TS 126ee409f2314ba091e87159b26c0c62 not found in new config with opid_index 30) from {username='slave'} at 127.0.0.1:50476
I20251214 21:03:22.705657 24546 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:22.706561 24659 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:22.707214 23883 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 14f65411fb9c45b0892ef02beae5b884 with cas_config_opid_index 30: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:22.707490 24546 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.707903 23998 raft_consensus.cc:2955] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.707924 23887 catalog_manager.cc:5654] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index 30 to 31, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:22.709326 24666 tablet_replica.cc:333] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:22.709466 24666 raft_consensus.cc:2243] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:22.709573 24666 raft_consensus.cc:2272] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:22.710233 24666 ts_tablet_manager.cc:1916] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:22.710610 24139 tablet_service.cc:1552] Processing DeleteTablet for tablet 14f65411fb9c45b0892ef02beae5b884 with delete_type TABLET_DATA_TOMBSTONED (TS fe19ae24b84b428e8559931c04f1a6b2 not found in new config with opid_index 31) from {username='slave'} at 127.0.0.1:37106
I20251214 21:03:22.712932 24666 ts_tablet_manager.cc:1929] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.29
I20251214 21:03:22.713024 24666 log.cc:1199] T f498cd6fedac4052b7593b1dda35af6a P 126ee409f2314ba091e87159b26c0c62: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/f498cd6fedac4052b7593b1dda35af6a
I20251214 21:03:22.713490 23881 catalog_manager.cc:4985] TS 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681): tablet f498cd6fedac4052b7593b1dda35af6a (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:22.715325 24672 tablet_replica.cc:333] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:22.715502 24672 raft_consensus.cc:2243] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:22.715688 24672 raft_consensus.cc:2272] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:22.716322 24672 ts_tablet_manager.cc:1916] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:22.718554 24672 ts_tablet_manager.cc:1929] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.30
I20251214 21:03:22.718631 24672 log.cc:1199] T 14f65411fb9c45b0892ef02beae5b884 P fe19ae24b84b428e8559931c04f1a6b2: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/14f65411fb9c45b0892ef02beae5b884
I20251214 21:03:22.720800 23882 catalog_manager.cc:4985] TS fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947): tablet 14f65411fb9c45b0892ef02beae5b884 (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:22.789269 24638 raft_consensus.cc:1064] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: attempting to promote NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 to VOTER
I20251214 21:03:22.789647 24638 consensus_queue.cc:237] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:22.790968 24150 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.791038 24072 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.791049 24546 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 LEARNER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:22.791312 24627 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.791464 24638 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.791567 24641 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:22.793577 24627 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.794200 24145 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.795800 24546 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.796021 23896 catalog_manager.cc:5654] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 28 to 29, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:22.797483 24072 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.798508 23998 consensus_queue.cc:237] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:22.799795 24072 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:22.800217 24546 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:22.800457 24639 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.800630 24641 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:22.802345 24638 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.802670 24546 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.802733 24072 raft_consensus.cc:2955] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.804628 23896 catalog_manager.cc:5654] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 reported cstate change: config changed from index 29 to 30, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:22.805060 23881 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 445f6b3b3b63458abdaa3054956e957b with cas_config_opid_index 29: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:22.806926 24139 tablet_service.cc:1552] Processing DeleteTablet for tablet 445f6b3b3b63458abdaa3054956e957b with delete_type TABLET_DATA_TOMBSTONED (TS fe19ae24b84b428e8559931c04f1a6b2 not found in new config with opid_index 30) from {username='slave'} at 127.0.0.1:37106
I20251214 21:03:22.807459 24672 tablet_replica.cc:333] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:22.807606 24672 raft_consensus.cc:2243] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:22.807844 24672 raft_consensus.cc:2272] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:22.808496 24672 ts_tablet_manager.cc:1916] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:22.810612 24672 ts_tablet_manager.cc:1929] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.29
I20251214 21:03:22.810701 24672 log.cc:1199] T 445f6b3b3b63458abdaa3054956e957b P fe19ae24b84b428e8559931c04f1a6b2: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/445f6b3b3b63458abdaa3054956e957b
I20251214 21:03:22.811137 23882 catalog_manager.cc:4985] TS fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947): tablet 445f6b3b3b63458abdaa3054956e957b (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:23.075579 23998 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251214 21:03:23.075922 24611 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:23.078245 24395 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 2 LEARNER]: Advancing to term 3
I20251214 21:03:23.078392 24072 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251214 21:03:23.078895 24662 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:23.079407 24395 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 3 index: 30. (index mismatch)
I20251214 21:03:23.080504 24662 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:23.082567 24662 raft_consensus.cc:1064] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
I20251214 21:03:23.082888 24662 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 3.30, Last appended by leader: 29, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:23.083956 24072 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 3 index: 31. (index mismatch)
I20251214 21:03:23.084295 24650 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:23.084352 23998 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 3 index: 31. (index mismatch)
I20251214 21:03:23.084749 24650 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:23.085125 24395 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 30. Preceding OpId from leader: term: 3 index: 31. (index mismatch)
I20251214 21:03:23.085408 24650 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:23.086522 24611 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Committing config change with OpId 3.31: config changed from index 28 to 31, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:23.086879 23998 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Committing config change with OpId 3.31: config changed from index 28 to 31, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:23.088426 24072 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Committing config change with OpId 3.31: config changed from index 28 to 31, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:23.088996 23894 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 28 to 31, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:23.089463 24395 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Committing config change with OpId 3.31: config changed from index 28 to 31, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:23.093552 24150 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 3.31, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:23.094597 24395 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251214 21:03:23.094623 23998 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251214 21:03:23.094952 24662 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:23.095122 24650 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:23.096369 24662 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Committing config change with OpId 3.32: config changed from index 31 to 32, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:23.096866 24395 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Committing config change with OpId 3.32: config changed from index 31 to 32, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:23.097733 23882 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet f19d4d6bfd10472094bb7a6f81cd06b4 with cas_config_opid_index 31: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:23.098369 23998 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Committing config change with OpId 3.32: config changed from index 31 to 32, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:23.098693 23894 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index 31 to 32, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New cstate: current_term: 3 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:23.101505 24056 tablet_service.cc:1552] Processing DeleteTablet for tablet f19d4d6bfd10472094bb7a6f81cd06b4 with delete_type TABLET_DATA_TOMBSTONED (TS 68bf8595326044d78e9d47fe858479d4 not found in new config with opid_index 32) from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:23.102015 24685 tablet_replica.cc:333] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:23.102141 24685 raft_consensus.cc:2243] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:23.102294 24685 raft_consensus.cc:2272] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:23.102800 24685 ts_tablet_manager.cc:1916] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:23.104559 24685 ts_tablet_manager.cc:1929] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.31
I20251214 21:03:23.104621 24685 log.cc:1199] T f19d4d6bfd10472094bb7a6f81cd06b4 P 68bf8595326044d78e9d47fe858479d4: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/f19d4d6bfd10472094bb7a6f81cd06b4
I20251214 21:03:23.104981 23883 catalog_manager.cc:4985] TS 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): tablet f19d4d6bfd10472094bb7a6f81cd06b4 (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:24.101795 24145 consensus_queue.cc:237] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:24.103274 23998 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:24.103351 24072 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:24.103765 24690 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:24.103943 24689 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
W20251214 21:03:24.104127 24113 consensus_peers.cc:597] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 -> Peer b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823): Couldn't send request to peer b4706a6e7f19453ebb19fbfb8ef7558b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d246d019db6f483dab560d45620c2aec. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:24.105413 24611 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:24.105908 24072 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:24.107287 23998 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:24.108127 24072 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 23, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:24.108137 23887 catalog_manager.cc:5654] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.109588 24469 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251214 21:03:24.109591 24145 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
W20251214 21:03:24.109659 24041 consensus_peers.cc:597] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c649579f0f94f23aca3eafa7d81df2e. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:24.110065 24687 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:24.110392 24695 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:24.111719 24687 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.32: config changed from index 31 to 32, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:24.113270 24145 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.32: config changed from index 31 to 32, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:24.113507 24469 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Committing config change with OpId 2.32: config changed from index 31 to 32, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:24.114416 23894 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index 31 to 32, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.116425 24145 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:24.117600 24469 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20251214 21:03:24.117738 24072 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
W20251214 21:03:24.117841 24114 consensus_peers.cc:597] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 -> Peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145): Couldn't send request to peer f0fd707333e94628b613b5d3387fc999. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f498cd6fedac4052b7593b1dda35af6a. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:24.118134 24611 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:24.118314 24689 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:24.119724 24611 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:24.120101 24072 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:24.121608 24469 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:24.122037 23887 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index 30 to 31, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.123359 23998 consensus_queue.cc:237] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:24.124869 24145 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20251214 21:03:24.125073 24072 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
W20251214 21:03:24.124902 23963 consensus_peers.cc:597] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 -> Peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145): Couldn't send request to peer f0fd707333e94628b613b5d3387fc999. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d13b1d13a93d4cc3940537b29baf147a. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:24.125262 24707 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251214 21:03:24.125674 24707 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251214 21:03:24.126881 24639 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:24.127219 24145 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:24.127331 24072 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index -1 to 26, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:24.129290 23896 catalog_manager.cc:5654] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index -1 to 26, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:24.129483 24072 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 2.24, Last appended by leader: 16, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:24.130800 23998 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 24. Preceding OpId from leader: term: 2 index: 25. (index mismatch)
W20251214 21:03:24.130836 24041 consensus_peers.cc:597] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3628382de7514932a1ea8072fb2eaeb8. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:24.131045 24145 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 24. Preceding OpId from leader: term: 2 index: 25. (index mismatch)
I20251214 21:03:24.131142 24695 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20251214 21:03:24.131546 24695 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20251214 21:03:24.133730 24696 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.25: config changed from index -1 to 25, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:24.134088 23998 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.25: config changed from index -1 to 25, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:24.135250 24145 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.25: config changed from index -1 to 25, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:24.135829 23887 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index -1 to 25, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.137161 24145 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:24.138572 24072 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
W20251214 21:03:24.138756 24113 consensus_peers.cc:597] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 -> Peer b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823): Couldn't send request to peer b4706a6e7f19453ebb19fbfb8ef7558b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab9fd25bf1604ae4a6c94a9fc07f32cd. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:24.138887 24689 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:24.138952 23998 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:24.139242 24689 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:24.140528 24690 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:24.140858 24072 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:24.140959 23998 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:24.143026 23894 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index -1 to 28, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:24.291566 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:24.300547 24072 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:24.300781 24072 raft_consensus.cc:606] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:24.301512 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:24.301630 24068 raft_consensus.cc:606] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:24.302273 23998 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "445f6b3b3b63458abdaa3054956e957b"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:24.302378 23998 raft_consensus.cc:606] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Received request to transfer leadership to TS a52fd6dfbfc440b19b28bcd675e1d210
I20251214 21:03:24.303074 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:24.303174 24068 raft_consensus.cc:606] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership to TS b4706a6e7f19453ebb19fbfb8ef7558b
I20251214 21:03:24.303776 24145 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d246d019db6f483dab560d45620c2aec"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:37144
I20251214 21:03:24.303864 24145 raft_consensus.cc:606] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:24.304463 24145 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:37144
I20251214 21:03:24.304564 24145 raft_consensus.cc:606] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:24.304807 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20251214 21:03:24.304944 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:24.458607 24708 raft_consensus.cc:993] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: : Instructing follower a52fd6dfbfc440b19b28bcd675e1d210 to start an election
I20251214 21:03:24.458755 24712 raft_consensus.cc:1081] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Signalling peer a52fd6dfbfc440b19b28bcd675e1d210 to start an election
I20251214 21:03:24.459161 24546 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "445f6b3b3b63458abdaa3054956e957b"
dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
from {username='slave'} at 127.0.0.1:48996
I20251214 21:03:24.459282 24546 raft_consensus.cc:493] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:24.459509 24546 raft_consensus.cc:3060] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.460376 24546 raft_consensus.cc:515] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:24.460812 24546 leader_election.cc:290] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [CANDIDATE]: Term 2 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:24.461057 23998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "445f6b3b3b63458abdaa3054956e957b" candidate_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:24.461166 23998 raft_consensus.cc:3055] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:24.461211 23998 raft_consensus.cc:740] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:24.461347 23998 consensus_queue.cc:260] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 30, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:24.461500 23998 raft_consensus.cc:3060] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.462432 23998 raft_consensus.cc:2468] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a52fd6dfbfc440b19b28bcd675e1d210 in term 2.
I20251214 21:03:24.462667 24510 leader_election.cc:304] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:24.463040 24722 raft_consensus.cc:2804] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:24.463219 24722 raft_consensus.cc:697] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEADER]: Becoming Leader. State: Replica: a52fd6dfbfc440b19b28bcd675e1d210, State: Running, Role: LEADER
I20251214 21:03:24.463363 24722 consensus_queue.cc:237] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 30, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:24.465059 23896 catalog_manager.cc:5654] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 reported cstate change: term changed from 1 to 2, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6). New cstate: current_term: 2 leader_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:24.465773 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "445f6b3b3b63458abdaa3054956e957b" candidate_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:24.465881 24068 raft_consensus.cc:3060] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.466856 24068 raft_consensus.cc:2468] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a52fd6dfbfc440b19b28bcd675e1d210 in term 2.
I20251214 21:03:24.496061 24725 ts_tablet_manager.cc:933] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: Initiating tablet copy from peer fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:24.496435 24725 tablet_copy_client.cc:323] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:32947
I20251214 21:03:24.496851 24160 tablet_copy_service.cc:140] P fe19ae24b84b428e8559931c04f1a6b2: Received BeginTabletCopySession request for tablet f498cd6fedac4052b7593b1dda35af6a from peer f0fd707333e94628b613b5d3387fc999 ({username='slave'} at 127.0.0.1:37170)
I20251214 21:03:24.496956 24160 tablet_copy_service.cc:161] P fe19ae24b84b428e8559931c04f1a6b2: Beginning new tablet copy session on tablet f498cd6fedac4052b7593b1dda35af6a from peer f0fd707333e94628b613b5d3387fc999 at {username='slave'} at 127.0.0.1:37170: session id = f0fd707333e94628b613b5d3387fc999-f498cd6fedac4052b7593b1dda35af6a
I20251214 21:03:24.497910 24160 tablet_copy_source_session.cc:215] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:24.498788 24725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f498cd6fedac4052b7593b1dda35af6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:24.501572 24725 tablet_copy_client.cc:806] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:24.501817 24725 tablet_copy_client.cc:670] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:24.502861 24726 tablet_copy_client.cc:1025] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:24.531956 24727 ts_tablet_manager.cc:933] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: Initiating tablet copy from peer 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681)
I20251214 21:03:24.532410 24727 tablet_copy_client.cc:323] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.1:39681
I20251214 21:03:24.532857 24009 tablet_copy_service.cc:140] P 126ee409f2314ba091e87159b26c0c62: Received BeginTabletCopySession request for tablet d13b1d13a93d4cc3940537b29baf147a from peer f0fd707333e94628b613b5d3387fc999 ({username='slave'} at 127.0.0.1:50550)
I20251214 21:03:24.532950 24009 tablet_copy_service.cc:161] P 126ee409f2314ba091e87159b26c0c62: Beginning new tablet copy session on tablet d13b1d13a93d4cc3940537b29baf147a from peer f0fd707333e94628b613b5d3387fc999 at {username='slave'} at 127.0.0.1:50550: session id = f0fd707333e94628b613b5d3387fc999-d13b1d13a93d4cc3940537b29baf147a
I20251214 21:03:24.534025 24009 tablet_copy_source_session.cc:215] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:24.534822 24727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13b1d13a93d4cc3940537b29baf147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:24.537204 24727 tablet_copy_client.cc:806] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:24.537423 24727 tablet_copy_client.cc:670] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:24.538453 24728 tablet_copy_client.cc:1025] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:24.558481 24729 ts_tablet_manager.cc:933] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: Initiating tablet copy from peer fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:24.558858 24729 tablet_copy_client.cc:323] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:32947
I20251214 21:03:24.559237 24160 tablet_copy_service.cc:140] P fe19ae24b84b428e8559931c04f1a6b2: Received BeginTabletCopySession request for tablet d246d019db6f483dab560d45620c2aec from peer b4706a6e7f19453ebb19fbfb8ef7558b ({username='slave'} at 127.0.0.1:37180)
I20251214 21:03:24.559347 24160 tablet_copy_service.cc:161] P fe19ae24b84b428e8559931c04f1a6b2: Beginning new tablet copy session on tablet d246d019db6f483dab560d45620c2aec from peer b4706a6e7f19453ebb19fbfb8ef7558b at {username='slave'} at 127.0.0.1:37180: session id = b4706a6e7f19453ebb19fbfb8ef7558b-d246d019db6f483dab560d45620c2aec
I20251214 21:03:24.560346 24160 tablet_copy_source_session.cc:215] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:24.560352 24687 raft_consensus.cc:993] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:24.560467 24687 raft_consensus.cc:1081] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:24.560802 23997 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50500
I20251214 21:03:24.560925 23997 raft_consensus.cc:493] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:24.560984 23997 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.561174 24729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d246d019db6f483dab560d45620c2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:24.562026 23997 raft_consensus.cc:515] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:24.562377 23997 leader_election.cc:290] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 3 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:24.562770 24072 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 3 candidate_status { last_received { term: 2 index: 31 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:24.562834 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 3 candidate_status { last_received { term: 2 index: 31 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:24.562870 24072 raft_consensus.cc:3055] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:24.562902 24546 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.563283 24729 tablet_copy_client.cc:806] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:24.563414 24729 tablet_copy_client.cc:670] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:24.563680 24546 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 3.
I20251214 21:03:24.563961 23965 leader_election.cc:304] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:24.564138 24712 raft_consensus.cc:2804] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:24.564215 24712 raft_consensus.cc:697] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:24.562908 24072 raft_consensus.cc:740] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:24.564567 24072 consensus_queue.cc:260] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 31, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:24.564364 24712 consensus_queue.cc:237] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 31, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:24.564713 24072 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.564740 24730 tablet_copy_client.cc:1025] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:24.565440 24072 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 3.
I20251214 21:03:24.566159 23896 catalog_manager.cc:5654] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 2 to 3, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 3 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.627758 24611 raft_consensus.cc:993] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:24.627877 24611 raft_consensus.cc:1081] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:24.628264 24068 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d246d019db6f483dab560d45620c2aec"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57956
I20251214 21:03:24.628393 24068 raft_consensus.cc:493] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:24.628456 24068 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.629776 24068 raft_consensus.cc:515] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:24.630306 24068 leader_election.cc:290] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:24.630520 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d246d019db6f483dab560d45620c2aec" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:24.630564 24732 ts_tablet_manager.cc:933] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: Initiating tablet copy from peer fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:24.630563 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d246d019db6f483dab560d45620c2aec" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:24.630683 23997 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.630717 24145 raft_consensus.cc:3055] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:24.630784 24145 raft_consensus.cc:740] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:24.630923 24732 tablet_copy_client.cc:323] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:32947
I20251214 21:03:24.630921 24145 consensus_queue.cc:260] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:24.631263 24145 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.631350 24160 tablet_copy_service.cc:140] P fe19ae24b84b428e8559931c04f1a6b2: Received BeginTabletCopySession request for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd from peer b4706a6e7f19453ebb19fbfb8ef7558b ({username='slave'} at 127.0.0.1:37180)
I20251214 21:03:24.631433 24160 tablet_copy_service.cc:161] P fe19ae24b84b428e8559931c04f1a6b2: Beginning new tablet copy session on tablet ab9fd25bf1604ae4a6c94a9fc07f32cd from peer b4706a6e7f19453ebb19fbfb8ef7558b at {username='slave'} at 127.0.0.1:37180: session id = b4706a6e7f19453ebb19fbfb8ef7558b-ab9fd25bf1604ae4a6c94a9fc07f32cd
I20251214 21:03:24.631693 23997 raft_consensus.cc:2468] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:24.632156 24039 leader_election.cc:304] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:24.632197 24145 raft_consensus.cc:2468] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:24.632325 24687 raft_consensus.cc:2804] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:24.632392 24687 raft_consensus.cc:697] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:24.632438 24160 tablet_copy_source_session.cc:215] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:24.632510 24687 consensus_queue.cc:237] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:24.633643 24732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:24.634943 23896 catalog_manager.cc:5654] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 1 to 2, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.635653 24732 tablet_copy_client.cc:806] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:24.635788 24732 tablet_copy_client.cc:670] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:24.637120 24733 tablet_copy_client.cc:1025] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:24.707302 24690 raft_consensus.cc:993] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:24.707441 24690 raft_consensus.cc:1081] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:24.707778 24073 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57956
I20251214 21:03:24.707916 24073 raft_consensus.cc:493] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:24.707973 24073 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.709136 24073 raft_consensus.cc:515] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:24.709508 24073 leader_election.cc:290] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Requested vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823)
I20251214 21:03:24.709852 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:24.709968 24145 raft_consensus.cc:3055] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:24.710018 24145 raft_consensus.cc:740] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:24.710071 24469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: true dest_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
I20251214 21:03:24.710151 24469 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.710166 24145 consensus_queue.cc:260] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 31, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:24.710371 24145 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:24.711136 24469 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:24.711179 24145 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:24.711390 24040 leader_election.cc:304] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:24.711553 24687 raft_consensus.cc:2804] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:24.711732 24687 raft_consensus.cc:697] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:24.711884 24687 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 31, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:24.713825 23896 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 1 to 2, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.717878 24073 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:24.718000 24073 raft_consensus.cc:606] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership
I20251214 21:03:24.722362 24696 raft_consensus.cc:993] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: : Instructing follower b4706a6e7f19453ebb19fbfb8ef7558b to start an election
I20251214 21:03:24.722486 24696 raft_consensus.cc:1081] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Signalling peer b4706a6e7f19453ebb19fbfb8ef7558b to start an election
I20251214 21:03:24.722856 24469 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e"
dest_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
from {username='slave'} at 127.0.0.1:45078
I20251214 21:03:24.722967 24469 raft_consensus.cc:493] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:24.723027 24469 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.723433 24073 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:24.723706 24073 raft_consensus.cc:606] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership
I20251214 21:03:24.723834 24734 ts_tablet_manager.cc:933] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: Initiating tablet copy from peer 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:24.723959 24469 raft_consensus.cc:515] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
W20251214 21:03:24.723968 23883 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for f498cd6fedac4052b7593b1dda35af6a already in progress [suppressed 2 similar messages]
I20251214 21:03:24.724234 24734 tablet_copy_client.cc:323] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:36087
I20251214 21:03:24.724450 24469 leader_election.cc:290] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [CANDIDATE]: Term 3 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:24.724623 24085 tablet_copy_service.cc:140] P 68bf8595326044d78e9d47fe858479d4: Received BeginTabletCopySession request for tablet 4c649579f0f94f23aca3eafa7d81df2e from peer a52fd6dfbfc440b19b28bcd675e1d210 ({username='slave'} at 127.0.0.1:40990)
I20251214 21:03:24.724699 24085 tablet_copy_service.cc:161] P 68bf8595326044d78e9d47fe858479d4: Beginning new tablet copy session on tablet 4c649579f0f94f23aca3eafa7d81df2e from peer a52fd6dfbfc440b19b28bcd675e1d210 at {username='slave'} at 127.0.0.1:40990: session id = a52fd6dfbfc440b19b28bcd675e1d210-4c649579f0f94f23aca3eafa7d81df2e
I20251214 21:03:24.724701 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" candidate_term: 3 candidate_status { last_received { term: 2 index: 32 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:24.724830 24145 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.724968 24073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c649579f0f94f23aca3eafa7d81df2e" candidate_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" candidate_term: 3 candidate_status { last_received { term: 2 index: 32 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:24.725064 24073 raft_consensus.cc:3055] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:24.725107 24073 raft_consensus.cc:740] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:24.725237 24073 consensus_queue.cc:260] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 2.32, Last appended by leader: 32, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:24.725396 24073 raft_consensus.cc:3060] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.725646 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:24.725746 24145 raft_consensus.cc:2468] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4706a6e7f19453ebb19fbfb8ef7558b in term 3.
I20251214 21:03:24.725792 24068 raft_consensus.cc:606] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership
I20251214 21:03:24.726012 24436 leader_election.cc:304] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4706a6e7f19453ebb19fbfb8ef7558b, fe19ae24b84b428e8559931c04f1a6b2; no voters:
W20251214 21:03:24.726131 23944 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for f498cd6fedac4052b7593b1dda35af6a already in progress
W20251214 21:03:24.726171 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f498cd6fedac4052b7593b1dda35af6a already in progress
I20251214 21:03:24.726263 24737 raft_consensus.cc:2804] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:24.726351 24073 raft_consensus.cc:2468] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4706a6e7f19453ebb19fbfb8ef7558b in term 3.
I20251214 21:03:24.726476 24737 raft_consensus.cc:697] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Becoming Leader. State: Replica: b4706a6e7f19453ebb19fbfb8ef7558b, State: Running, Role: LEADER
I20251214 21:03:24.726715 24085 tablet_copy_source_session.cc:215] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:24.726686 24737 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 2.32, Last appended by leader: 32, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:24.727560 24734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c649579f0f94f23aca3eafa7d81df2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:24.729841 24734 tablet_copy_client.cc:806] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:24.729982 24734 tablet_copy_client.cc:670] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:24.729995 24739 ts_tablet_manager.cc:933] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: Initiating tablet copy from peer 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:24.730324 24739 tablet_copy_client.cc:323] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:36087
I20251214 21:03:24.730686 24084 tablet_copy_service.cc:140] P 68bf8595326044d78e9d47fe858479d4: Received BeginTabletCopySession request for tablet 3628382de7514932a1ea8072fb2eaeb8 from peer a52fd6dfbfc440b19b28bcd675e1d210 ({username='slave'} at 127.0.0.1:40990)
I20251214 21:03:24.730767 24084 tablet_copy_service.cc:161] P 68bf8595326044d78e9d47fe858479d4: Beginning new tablet copy session on tablet 3628382de7514932a1ea8072fb2eaeb8 from peer a52fd6dfbfc440b19b28bcd675e1d210 at {username='slave'} at 127.0.0.1:40990: session id = a52fd6dfbfc440b19b28bcd675e1d210-3628382de7514932a1ea8072fb2eaeb8
I20251214 21:03:24.730921 24736 tablet_copy_client.cc:1025] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:24.731559 24084 tablet_copy_source_session.cc:215] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:24.731751 23896 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: term changed from 2 to 3, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5). New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.732967 24739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3628382de7514932a1ea8072fb2eaeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:24.735212 24739 tablet_copy_client.cc:806] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:24.735353 24739 tablet_copy_client.cc:670] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:24.736383 24740 tablet_copy_client.cc:1025] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:24.759541 24687 raft_consensus.cc:993] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:24.759647 24687 raft_consensus.cc:1081] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:24.760003 23997 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50500
I20251214 21:03:24.760124 23997 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:24.760186 23997 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.760959 23997 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:24.761308 23997 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 3 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:24.761634 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 3 candidate_status { last_received { term: 2 index: 25 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:24.761747 24073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 3 candidate_status { last_received { term: 2 index: 25 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:24.761767 24145 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.761837 24073 raft_consensus.cc:3055] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:24.761880 24073 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:24.762023 24073 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 2.25, Last appended by leader: 25, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:24.762210 24073 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:24.762817 24145 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 3.
I20251214 21:03:24.763099 23964 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:24.763126 24073 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 3.
I20251214 21:03:24.763270 24712 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:24.763351 24712 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:24.763491 24712 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 2.25, Last appended by leader: 25, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:24.764997 23896 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 2 to 3, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 3 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:24.897325 24073 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Refusing update from remote peer a52fd6dfbfc440b19b28bcd675e1d210: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:24.897795 24722 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:24.900121 23997 raft_consensus.cc:1275] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer a52fd6dfbfc440b19b28bcd675e1d210: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:24.900560 24723 consensus_queue.cc:1048] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:24.966593 24073 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251214 21:03:24.966955 24708 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:24.969353 24546 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251214 21:03:24.969736 24708 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:25.030460 23997 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251214 21:03:25.030820 24687 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:25.033252 24150 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
W20251214 21:03:25.033432 24038 consensus_peers.cc:597] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 -> Peer b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823): Couldn't send request to peer b4706a6e7f19453ebb19fbfb8ef7558b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:25.033660 24750 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:25.157723 24150 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 25. Preceding OpId from leader: term: 3 index: 26. (index mismatch)
I20251214 21:03:25.158349 24752 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
W20251214 21:03:25.160655 23965 consensus_peers.cc:597] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:25.161090 24073 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 25. Preceding OpId from leader: term: 3 index: 26. (index mismatch)
I20251214 21:03:25.161454 24712 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20251214 21:03:25.162942 24150 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251214 21:03:25.163282 24696 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:25.165458 24750 raft_consensus.cc:993] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4: : Instructing follower fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:25.165542 24750 raft_consensus.cc:1081] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Signalling peer fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:25.166563 24469 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251214 21:03:25.166620 24150 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:37124
I20251214 21:03:25.166726 24150 raft_consensus.cc:493] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:25.166780 24150 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:25.167881 24150 raft_consensus.cc:515] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:25.168222 24150 leader_election.cc:290] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 3 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823)
I20251214 21:03:25.168502 24469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 32 } } ignore_live_leader: true dest_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
I20251214 21:03:25.168584 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 32 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:25.168692 24068 raft_consensus.cc:3055] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:25.168751 24068 raft_consensus.cc:740] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:25.168608 24469 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:25.168692 24687 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:25.169258 24068 consensus_queue.cc:260] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 2.32, Last appended by leader: 32, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:25.169407 24068 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:25.169859 24469 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 3.
I20251214 21:03:25.170130 24113 leader_election.cc:304] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4706a6e7f19453ebb19fbfb8ef7558b, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:25.170312 24753 raft_consensus.cc:2804] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:25.170403 24753 raft_consensus.cc:697] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:25.170483 24471 raft_consensus.cc:1240] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Rejecting Update request from peer 68bf8595326044d78e9d47fe858479d4 for earlier term 2. Current term is 3. Ops: [2.32-2.32]
I20251214 21:03:25.170521 24753 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 2.32, Last appended by leader: 32, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:25.170292 24068 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 3.
I20251214 21:03:25.171892 23896 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 2 to 3, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 3 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:03:25.230602 24437 consensus_peers.cc:597] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:25.260859 24150 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 2 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:25.261255 24737 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:25.263718 24068 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 2 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:25.264200 24763 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
W20251214 21:03:25.587303 24114 consensus_peers.cc:597] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 -> Peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145): Couldn't send request to peer f0fd707333e94628b613b5d3387fc999. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:25.609510 24471 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:25.609912 24753 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:25.613519 24073 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:25.613987 24690 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:26.305207 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:26.307190 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "01da8ce246384c7cb83053adfcffe77a"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "f0fd707333e94628b613b5d3387fc999"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:26.307355 23997 raft_consensus.cc:606] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Received request to transfer leadership to TS f0fd707333e94628b613b5d3387fc999
I20251214 21:03:26.308143 24073 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:26.308276 24073 raft_consensus.cc:606] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:26.309141 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:26.309258 23997 raft_consensus.cc:606] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:26.309901 24150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:37144
I20251214 21:03:26.310014 24150 raft_consensus.cc:606] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:26.310298 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20251214 21:03:26.310423 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:26.427793 24755 raft_consensus.cc:993] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: : Instructing follower f0fd707333e94628b613b5d3387fc999 to start an election
I20251214 21:03:26.427942 24755 raft_consensus.cc:1081] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Signalling peer f0fd707333e94628b613b5d3387fc999 to start an election
I20251214 21:03:26.428364 24395 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "01da8ce246384c7cb83053adfcffe77a"
dest_uuid: "f0fd707333e94628b613b5d3387fc999"
from {username='slave'} at 127.0.0.1:53620
I20251214 21:03:26.428498 24395 raft_consensus.cc:493] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:26.428556 24395 raft_consensus.cc:3060] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:26.429469 24395 raft_consensus.cc:515] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:26.429981 24395 leader_election.cc:290] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [CANDIDATE]: Term 2 election: Requested vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681)
I20251214 21:03:26.430315 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01da8ce246384c7cb83053adfcffe77a" candidate_uuid: "f0fd707333e94628b613b5d3387fc999" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:26.430369 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01da8ce246384c7cb83053adfcffe77a" candidate_uuid: "f0fd707333e94628b613b5d3387fc999" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:26.430433 24150 raft_consensus.cc:3060] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:26.430482 23997 raft_consensus.cc:3055] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:26.430542 23997 raft_consensus.cc:740] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:26.430677 23997 consensus_queue.cc:260] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 30, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:26.430837 23997 raft_consensus.cc:3060] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:26.431504 24150 raft_consensus.cc:2468] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0fd707333e94628b613b5d3387fc999 in term 2.
I20251214 21:03:26.431663 23997 raft_consensus.cc:2468] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0fd707333e94628b613b5d3387fc999 in term 2.
I20251214 21:03:26.431770 24360 leader_election.cc:304] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0fd707333e94628b613b5d3387fc999, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:26.432050 24773 raft_consensus.cc:2804] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:26.432200 24773 raft_consensus.cc:697] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 2 LEADER]: Becoming Leader. State: Replica: f0fd707333e94628b613b5d3387fc999, State: Running, Role: LEADER
I20251214 21:03:26.432360 24773 consensus_queue.cc:237] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 30, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:26.433853 23887 catalog_manager.cc:5654] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 reported cstate change: term changed from 1 to 2, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to f0fd707333e94628b613b5d3387fc999 (127.20.32.4). New cstate: current_term: 2 leader_uuid: "f0fd707333e94628b613b5d3387fc999" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:26.503155 24725 tablet_copy_client.cc:538] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:26.504848 24725 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: Bootstrap starting.
I20251214 21:03:26.529198 24725 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: Bootstrap replayed 1/1 log segments. Stats: ops{read=31 overwritten=0 applied=31 ignored=0} inserts{seen=125 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:26.529541 24725 tablet_bootstrap.cc:492] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: Bootstrap complete.
I20251214 21:03:26.529781 24725 ts_tablet_manager.cc:1403] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.011s
I20251214 21:03:26.530274 24725 raft_consensus.cc:359] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:26.530419 24725 raft_consensus.cc:740] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f0fd707333e94628b613b5d3387fc999, State: Initialized, Role: LEARNER
I20251214 21:03:26.530525 24725 consensus_queue.cc:260] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 31, Last appended: 1.31, Last appended by leader: 31, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:26.530795 24725 ts_tablet_manager.cc:1434] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:26.531188 24160 tablet_copy_service.cc:342] P fe19ae24b84b428e8559931c04f1a6b2: Request end of tablet copy session f0fd707333e94628b613b5d3387fc999-f498cd6fedac4052b7593b1dda35af6a received from {username='slave'} at 127.0.0.1:37170
I20251214 21:03:26.531255 24160 tablet_copy_service.cc:434] P fe19ae24b84b428e8559931c04f1a6b2: ending tablet copy session f0fd707333e94628b613b5d3387fc999-f498cd6fedac4052b7593b1dda35af6a on tablet f498cd6fedac4052b7593b1dda35af6a with peer f0fd707333e94628b613b5d3387fc999
I20251214 21:03:26.538741 24727 tablet_copy_client.cc:538] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:26.540181 24727 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: Bootstrap starting.
I20251214 21:03:26.550307 24687 raft_consensus.cc:993] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:26.550418 24687 raft_consensus.cc:1081] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:26.550758 23998 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50500
I20251214 21:03:26.550887 23998 raft_consensus.cc:493] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:26.550953 23998 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:26.552063 23998 raft_consensus.cc:515] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:26.552430 23998 leader_election.cc:290] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 2 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:26.552785 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:26.552821 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:26.552884 24068 raft_consensus.cc:3055] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:26.552922 24068 raft_consensus.cc:740] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:26.552938 24150 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:26.553041 24068 consensus_queue.cc:260] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:26.553179 24068 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:26.553934 24068 raft_consensus.cc:2468] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 2.
I20251214 21:03:26.553957 24150 raft_consensus.cc:2468] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 2.
I20251214 21:03:26.554383 23965 leader_election.cc:304] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, 68bf8595326044d78e9d47fe858479d4; no voters:
I20251214 21:03:26.554579 24755 raft_consensus.cc:2804] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:26.554666 24755 raft_consensus.cc:697] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:26.554793 24755 consensus_queue.cc:237] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:26.556347 23887 catalog_manager.cc:5654] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 1 to 2, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 2 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:26.560804 24727 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=94 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:26.561105 24727 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: Bootstrap complete.
I20251214 21:03:26.561278 24727 ts_tablet_manager.cc:1403] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: Time spent bootstrapping tablet: real 0.021s user 0.019s sys 0.000s
I20251214 21:03:26.561733 24727 raft_consensus.cc:359] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:26.561853 24727 raft_consensus.cc:740] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f0fd707333e94628b613b5d3387fc999, State: Initialized, Role: LEARNER
I20251214 21:03:26.561956 24727 consensus_queue.cc:260] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:26.562213 24727 ts_tablet_manager.cc:1434] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20251214 21:03:26.562641 24009 tablet_copy_service.cc:342] P 126ee409f2314ba091e87159b26c0c62: Request end of tablet copy session f0fd707333e94628b613b5d3387fc999-d13b1d13a93d4cc3940537b29baf147a received from {username='slave'} at 127.0.0.1:50550
I20251214 21:03:26.562726 24009 tablet_copy_service.cc:434] P 126ee409f2314ba091e87159b26c0c62: ending tablet copy session f0fd707333e94628b613b5d3387fc999-d13b1d13a93d4cc3940537b29baf147a on tablet d13b1d13a93d4cc3940537b29baf147a with peer f0fd707333e94628b613b5d3387fc999
I20251214 21:03:26.564986 24729 tablet_copy_client.cc:538] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:26.566270 24729 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap starting.
I20251214 21:03:26.579020 24395 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Advancing to term 3
I20251214 21:03:26.580173 24395 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251214 21:03:26.580657 24690 consensus_queue.cc:1050] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:26.582545 24771 raft_consensus.cc:1064] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
W20251214 21:03:26.582613 24771 raft_consensus.cc:1067] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: Unable to promote non-voter f0fd707333e94628b613b5d3387fc999: Service unavailable: leader transfer in progress
I20251214 21:03:26.587975 24729 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap replayed 1/1 log segments. Stats: ops{read=28 overwritten=0 applied=28 ignored=0} inserts{seen=109 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:26.588258 24729 tablet_bootstrap.cc:492] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap complete.
I20251214 21:03:26.588428 24729 ts_tablet_manager.cc:1403] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent bootstrapping tablet: real 0.022s user 0.019s sys 0.000s
I20251214 21:03:26.588862 24729 raft_consensus.cc:359] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:26.588979 24729 raft_consensus.cc:740] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b4706a6e7f19453ebb19fbfb8ef7558b, State: Initialized, Role: LEARNER
I20251214 21:03:26.589077 24729 consensus_queue.cc:260] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:26.589459 24729 ts_tablet_manager.cc:1434] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:03:26.589844 24160 tablet_copy_service.cc:342] P fe19ae24b84b428e8559931c04f1a6b2: Request end of tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-d246d019db6f483dab560d45620c2aec received from {username='slave'} at 127.0.0.1:37180
I20251214 21:03:26.589931 24160 tablet_copy_service.cc:434] P fe19ae24b84b428e8559931c04f1a6b2: ending tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-d246d019db6f483dab560d45620c2aec on tablet d246d019db6f483dab560d45620c2aec with peer b4706a6e7f19453ebb19fbfb8ef7558b
I20251214 21:03:26.630309 24772 raft_consensus.cc:993] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:26.630466 24772 raft_consensus.cc:1081] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:26.630877 24068 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57968
I20251214 21:03:26.631009 24068 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:26.631076 24068 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:26.631415 24395 raft_consensus.cc:1217] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.25->[1.26-1.26] Dedup: 1.26->[]
I20251214 21:03:26.632268 24068 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:26.632807 24068 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 4 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:26.632912 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 26 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:26.633010 24150 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:26.633821 24150 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 4.
I20251214 21:03:26.632921 23998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 26 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:26.634233 23998 raft_consensus.cc:3055] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Stepping down as leader of term 3
I20251214 21:03:26.634282 23998 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:26.634426 23998 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 3.26, Last appended by leader: 26, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:26.634588 23998 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:26.635272 23998 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 4.
I20251214 21:03:26.635525 24040 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:26.635673 24782 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Leader election won for term 4
I20251214 21:03:26.635761 24782 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:26.635895 24782 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 3.26, Last appended by leader: 26, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:26.637355 24732 tablet_copy_client.cc:538] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:26.637562 23887 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 3 to 4, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 4 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:26.638654 24732 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap starting.
I20251214 21:03:26.660211 24732 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap replayed 1/1 log segments. Stats: ops{read=28 overwritten=0 applied=28 ignored=0} inserts{seen=99 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:26.660511 24732 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap complete.
I20251214 21:03:26.660703 24732 ts_tablet_manager.cc:1403] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent bootstrapping tablet: real 0.022s user 0.016s sys 0.003s
I20251214 21:03:26.661669 24732 raft_consensus.cc:359] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:26.661834 24732 raft_consensus.cc:740] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b4706a6e7f19453ebb19fbfb8ef7558b, State: Initialized, Role: LEARNER
I20251214 21:03:26.661937 24732 consensus_queue.cc:260] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 28, Last appended: 1.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:26.662256 24732 ts_tablet_manager.cc:1434] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20251214 21:03:26.662673 24160 tablet_copy_service.cc:342] P fe19ae24b84b428e8559931c04f1a6b2: Request end of tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-ab9fd25bf1604ae4a6c94a9fc07f32cd received from {username='slave'} at 127.0.0.1:37180
I20251214 21:03:26.662765 24160 tablet_copy_service.cc:434] P fe19ae24b84b428e8559931c04f1a6b2: ending tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-ab9fd25bf1604ae4a6c94a9fc07f32cd on tablet ab9fd25bf1604ae4a6c94a9fc07f32cd with peer b4706a6e7f19453ebb19fbfb8ef7558b
I20251214 21:03:26.670764 24771 raft_consensus.cc:993] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:26.670864 24771 raft_consensus.cc:1081] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:26.671213 24068 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57956
I20251214 21:03:26.671331 24068 raft_consensus.cc:493] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:26.671393 24068 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:26.672420 24068 raft_consensus.cc:515] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:26.672782 24068 leader_election.cc:290] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 4 election: Requested vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823)
I20251214 21:03:26.672966 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 33 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:26.673038 24471 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f498cd6fedac4052b7593b1dda35af6a" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 33 } } ignore_live_leader: true dest_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
I20251214 21:03:26.673060 24145 raft_consensus.cc:3055] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Stepping down as leader of term 3
I20251214 21:03:26.673106 24145 raft_consensus.cc:740] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:26.673111 24471 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:26.673256 24145 consensus_queue.cc:260] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 3.33, Last appended by leader: 33, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:26.673418 24145 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:26.674204 24471 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 4.
I20251214 21:03:26.674204 24145 raft_consensus.cc:2468] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 4.
I20251214 21:03:26.674491 24040 leader_election.cc:304] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:26.674656 24687 raft_consensus.cc:2804] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Leader election won for term 4
I20251214 21:03:26.674741 24687 raft_consensus.cc:697] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:26.674865 24687 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 3.33, Last appended by leader: 33, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:26.676553 23887 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 3 to 4, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 4 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:26.731196 24734 tablet_copy_client.cc:538] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:26.733042 24734 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap starting.
I20251214 21:03:26.736624 24739 tablet_copy_client.cc:538] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:26.738098 24739 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap starting.
I20251214 21:03:26.758459 24739 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap replayed 1/1 log segments. Stats: ops{read=25 overwritten=0 applied=25 ignored=0} inserts{seen=96 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:26.758823 24739 tablet_bootstrap.cc:492] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap complete.
I20251214 21:03:26.759020 24739 ts_tablet_manager.cc:1403] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: Time spent bootstrapping tablet: real 0.021s user 0.020s sys 0.000s
I20251214 21:03:26.759577 24734 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap replayed 1/1 log segments. Stats: ops{read=32 overwritten=0 applied=32 ignored=0} inserts{seen=109 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:26.759513 24739 raft_consensus.cc:359] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:26.759665 24739 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a52fd6dfbfc440b19b28bcd675e1d210, State: Initialized, Role: LEARNER
I20251214 21:03:26.759768 24739 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 25, Last appended: 2.25, Last appended by leader: 25, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:26.759847 24734 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap complete.
I20251214 21:03:26.760030 24734 ts_tablet_manager.cc:1403] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: Time spent bootstrapping tablet: real 0.027s user 0.025s sys 0.000s
I20251214 21:03:26.760344 24739 ts_tablet_manager.cc:1434] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:26.760646 24734 raft_consensus.cc:359] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:26.760717 24084 tablet_copy_service.cc:342] P 68bf8595326044d78e9d47fe858479d4: Request end of tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-3628382de7514932a1ea8072fb2eaeb8 received from {username='slave'} at 127.0.0.1:40990
I20251214 21:03:26.760752 24734 raft_consensus.cc:740] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a52fd6dfbfc440b19b28bcd675e1d210, State: Initialized, Role: LEARNER
I20251214 21:03:26.760780 24084 tablet_copy_service.cc:434] P 68bf8595326044d78e9d47fe858479d4: ending tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-3628382de7514932a1ea8072fb2eaeb8 on tablet 3628382de7514932a1ea8072fb2eaeb8 with peer a52fd6dfbfc440b19b28bcd675e1d210
I20251214 21:03:26.760841 24734 consensus_queue.cc:260] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 32, Last appended: 2.32, Last appended by leader: 32, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:26.761308 24734 ts_tablet_manager.cc:1434] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:03:26.761936 24084 tablet_copy_service.cc:342] P 68bf8595326044d78e9d47fe858479d4: Request end of tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-4c649579f0f94f23aca3eafa7d81df2e received from {username='slave'} at 127.0.0.1:40990
I20251214 21:03:26.762012 24084 tablet_copy_service.cc:434] P 68bf8595326044d78e9d47fe858479d4: ending tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-4c649579f0f94f23aca3eafa7d81df2e on tablet 4c649579f0f94f23aca3eafa7d81df2e with peer a52fd6dfbfc440b19b28bcd675e1d210
I20251214 21:03:26.823235 24145 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:26.823625 24773 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:26.825757 23998 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:26.826086 24774 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:26.943876 24471 raft_consensus.cc:1217] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.27->[1.28-1.28] Dedup: 1.28->[]
I20251214 21:03:26.971925 24068 raft_consensus.cc:1275] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251214 21:03:26.972332 24772 consensus_queue.cc:1048] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251214 21:03:26.974654 24145 raft_consensus.cc:1275] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 2 index: 27. (index mismatch)
I20251214 21:03:26.975121 24755 consensus_queue.cc:1048] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251214 21:03:27.053329 24145 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 26. Preceding OpId from leader: term: 4 index: 27. (index mismatch)
I20251214 21:03:27.053682 24687 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251214 21:03:27.055671 24546 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEARNER]: Advancing to term 4
I20251214 21:03:27.056435 23998 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 26. Preceding OpId from leader: term: 4 index: 27. (index mismatch)
I20251214 21:03:27.056828 24546 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 LEARNER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 25. Preceding OpId from leader: term: 4 index: 27. (index mismatch)
I20251214 21:03:27.056804 24687 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251214 21:03:27.057250 24687 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 25, Time since last communication: 0.000s
I20251214 21:03:27.058885 24687 raft_consensus.cc:1064] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: attempting to promote NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 to VOTER
I20251214 21:03:27.059222 24687 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 4.27, Last appended by leader: 26, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:27.059722 24772 raft_consensus.cc:1064] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
I20251214 21:03:27.060073 24772 consensus_queue.cc:237] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:27.060674 23997 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 27. Preceding OpId from leader: term: 4 index: 28. (index mismatch)
I20251214 21:03:27.061120 24803 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:27.061471 24395 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251214 21:03:27.061496 24145 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251214 21:03:27.061949 24546 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 LEARNER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 27. Preceding OpId from leader: term: 4 index: 28. (index mismatch)
I20251214 21:03:27.062023 24755 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251214 21:03:27.062320 24755 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251214 21:03:27.062362 24803 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:27.062363 24145 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 27. Preceding OpId from leader: term: 4 index: 28. (index mismatch)
I20251214 21:03:27.063566 24803 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:27.063840 24803 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Committing config change with OpId 4.28: config changed from index 25 to 28, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.064277 24546 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Committing config change with OpId 4.28: config changed from index 25 to 28, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.063758 24068 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20251214 21:03:27.065282 24772 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20251214 21:03:27.065809 24150 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Committing config change with OpId 4.28: config changed from index 25 to 28, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.066622 23997 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Committing config change with OpId 4.28: config changed from index 25 to 28, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.068396 23887 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index 25 to 28, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.068828 24772 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.070446 24150 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.072239 23896 catalog_manager.cc:5654] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 26 to 27, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:27.072352 24073 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.072220 24395 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.075627 23998 consensus_queue.cc:237] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:27.075892 24073 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 4.28, Last appended by leader: 26, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:27.076961 24395 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:27.077011 24546 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 28. Preceding OpId from leader: term: 4 index: 29. (index mismatch)
I20251214 21:03:27.077128 24150 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20251214 21:03:27.077165 23998 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 28. Preceding OpId from leader: term: 4 index: 29. (index mismatch)
I20251214 21:03:27.077426 24803 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:27.077562 24812 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:27.077626 24755 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:27.077894 24755 consensus_queue.cc:1050] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 1.27, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:27.079334 24755 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.079809 24395 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.080471 24782 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Committing config change with OpId 4.29: config changed from index 28 to 29, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.081274 23881 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d13b1d13a93d4cc3940537b29baf147a with cas_config_opid_index 27: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:27.081571 24150 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.082254 23894 catalog_manager.cc:5654] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 27 to 28, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:27.081195 24546 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Committing config change with OpId 4.29: config changed from index 28 to 29, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.082862 23883 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3628382de7514932a1ea8072fb2eaeb8 with cas_config_opid_index 28: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:27.083123 23997 raft_consensus.cc:2955] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Committing config change with OpId 4.29: config changed from index 28 to 29, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.084028 23889 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index 28 to 29, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New cstate: current_term: 4 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:27.085275 24056 tablet_service.cc:1552] Processing DeleteTablet for tablet d13b1d13a93d4cc3940537b29baf147a with delete_type TABLET_DATA_TOMBSTONED (TS 68bf8595326044d78e9d47fe858479d4 not found in new config with opid_index 28) from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:27.085589 24814 tablet_replica.cc:333] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:27.085755 24814 raft_consensus.cc:2243] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:27.085898 24814 raft_consensus.cc:2272] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:27.086769 24139 tablet_service.cc:1552] Processing DeleteTablet for tablet 3628382de7514932a1ea8072fb2eaeb8 with delete_type TABLET_DATA_TOMBSTONED (TS fe19ae24b84b428e8559931c04f1a6b2 not found in new config with opid_index 29) from {username='slave'} at 127.0.0.1:37106
I20251214 21:03:27.087378 24815 tablet_replica.cc:333] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:27.087502 24815 raft_consensus.cc:2243] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:27.087528 24814 ts_tablet_manager.cc:1916] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:27.087664 24815 raft_consensus.cc:2272] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:27.088193 24815 ts_tablet_manager.cc:1916] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:27.089507 24814 ts_tablet_manager.cc:1929] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.27
I20251214 21:03:27.089573 24814 log.cc:1199] T d13b1d13a93d4cc3940537b29baf147a P 68bf8595326044d78e9d47fe858479d4: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/d13b1d13a93d4cc3940537b29baf147a
I20251214 21:03:27.090011 23883 catalog_manager.cc:4985] TS 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): tablet d13b1d13a93d4cc3940537b29baf147a (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:27.090298 24815 ts_tablet_manager.cc:1929] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.28
I20251214 21:03:27.090365 24815 log.cc:1199] T 3628382de7514932a1ea8072fb2eaeb8 P fe19ae24b84b428e8559931c04f1a6b2: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/3628382de7514932a1ea8072fb2eaeb8
I20251214 21:03:27.090840 23882 catalog_manager.cc:4985] TS fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947): tablet 3628382de7514932a1ea8072fb2eaeb8 (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:27.107137 24150 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 4 index: 34. (index mismatch)
I20251214 21:03:27.107504 24807 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:27.109584 24395 raft_consensus.cc:3060] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Advancing to term 4
I20251214 21:03:27.109887 24471 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 4 index: 34. (index mismatch)
I20251214 21:03:27.110240 24807 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:27.111068 24395 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 4 LEARNER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 4 index: 34. (index mismatch)
I20251214 21:03:27.111423 24803 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:27.113523 24812 raft_consensus.cc:1064] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
I20251214 21:03:27.113932 24812 consensus_queue.cc:237] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 4.34, Last appended by leader: 33, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:27.115427 24395 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 4 LEARNER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 34. Preceding OpId from leader: term: 4 index: 35. (index mismatch)
I20251214 21:03:27.115540 24469 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 34. Preceding OpId from leader: term: 4 index: 35. (index mismatch)
I20251214 21:03:27.115444 24145 raft_consensus.cc:1275] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 34. Preceding OpId from leader: term: 4 index: 35. (index mismatch)
I20251214 21:03:27.115969 24812 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:27.116086 24803 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:27.116192 24807 consensus_queue.cc:1048] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:27.117842 24812 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Committing config change with OpId 4.35: config changed from index 31 to 35, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.118296 24469 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 4 FOLLOWER]: Committing config change with OpId 4.35: config changed from index 31 to 35, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.118489 24395 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 4 FOLLOWER]: Committing config change with OpId 4.35: config changed from index 31 to 35, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.120469 23889 catalog_manager.cc:5654] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 reported cstate change: config changed from index 31 to 35, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.121331 24145 raft_consensus.cc:2955] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Committing config change with OpId 4.35: config changed from index 31 to 35, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:27.167312 24471 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Advancing to term 2
I20251214 21:03:27.359324 24771 raft_consensus.cc:1064] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: attempting to promote NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b to VOTER
I20251214 21:03:27.359805 24771 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:27.361202 24471 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:27.361294 24073 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:27.361559 24690 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:27.361915 23997 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:27.362253 24822 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:27.362447 24690 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:27.364163 24690 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.364425 24073 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.366605 23997 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.366961 23889 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.367828 24471 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.371172 24145 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:27.372184 24073 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:27.372684 24471 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:27.372771 24824 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:27.373059 24822 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:27.374485 24824 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.375058 24073 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.375058 24471 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.376075 23882 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd with cas_config_opid_index 29: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:27.377012 23896 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 reported cstate change: config changed from index 29 to 30, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.379690 23989 tablet_service.cc:1552] Processing DeleteTablet for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd with delete_type TABLET_DATA_TOMBSTONED (TS 126ee409f2314ba091e87159b26c0c62 not found in new config with opid_index 30) from {username='slave'} at 127.0.0.1:50476
I20251214 21:03:27.380220 24828 tablet_replica.cc:333] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:27.380465 24828 raft_consensus.cc:2243] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:27.380657 24828 raft_consensus.cc:2272] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:27.381259 24828 ts_tablet_manager.cc:1916] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:27.383437 24828 ts_tablet_manager.cc:1929] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.29
I20251214 21:03:27.383512 24828 log.cc:1199] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 126ee409f2314ba091e87159b26c0c62: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/ab9fd25bf1604ae4a6c94a9fc07f32cd
I20251214 21:03:27.383975 23881 catalog_manager.cc:4985] TS 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681): tablet ab9fd25bf1604ae4a6c94a9fc07f32cd (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:27.465168 24829 raft_consensus.cc:1064] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: attempting to promote NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 to VOTER
I20251214 21:03:27.465616 24829 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 3.33, Last appended by leader: 32, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:27.466866 24546 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 LEARNER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 3 index: 34. (index mismatch)
I20251214 21:03:27.467010 24145 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 3 index: 34. (index mismatch)
I20251214 21:03:27.467161 24073 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 3 index: 34. (index mismatch)
I20251214 21:03:27.467355 24819 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:27.467665 24819 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:27.467934 24819 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:27.469058 24831 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Committing config change with OpId 3.34: config changed from index 32 to 34, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.469419 24145 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Committing config change with OpId 3.34: config changed from index 32 to 34, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.471143 24546 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Committing config change with OpId 3.34: config changed from index 32 to 34, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.471529 23894 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index 32 to 34, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.473157 24068 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Committing config change with OpId 3.34: config changed from index 32 to 34, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.475844 24471 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 3.34, Last appended by leader: 32, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:27.476851 24546 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 34. Preceding OpId from leader: term: 3 index: 35. (index mismatch)
I20251214 21:03:27.476851 24073 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 34. Preceding OpId from leader: term: 3 index: 35. (index mismatch)
I20251214 21:03:27.477397 24770 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:27.477561 24819 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:27.479051 24770 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Committing config change with OpId 3.35: config changed from index 34 to 35, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.479353 24546 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Committing config change with OpId 3.35: config changed from index 34 to 35, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.479398 24073 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Committing config change with OpId 3.35: config changed from index 34 to 35, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:27.480859 23939 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4c649579f0f94f23aca3eafa7d81df2e with cas_config_opid_index 34: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:27.481534 23896 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: config changed from index 34 to 35, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:27.483947 24139 tablet_service.cc:1552] Processing DeleteTablet for tablet 4c649579f0f94f23aca3eafa7d81df2e with delete_type TABLET_DATA_TOMBSTONED (TS fe19ae24b84b428e8559931c04f1a6b2 not found in new config with opid_index 35) from {username='slave'} at 127.0.0.1:37106
I20251214 21:03:27.484138 24815 tablet_replica.cc:333] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:27.484269 24815 raft_consensus.cc:2243] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:27.484401 24815 raft_consensus.cc:2272] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:27.485020 24815 ts_tablet_manager.cc:1916] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:27.487279 24815 ts_tablet_manager.cc:1929] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.34
I20251214 21:03:27.487356 24815 log.cc:1199] T 4c649579f0f94f23aca3eafa7d81df2e P fe19ae24b84b428e8559931c04f1a6b2: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/4c649579f0f94f23aca3eafa7d81df2e
I20251214 21:03:27.487789 23882 catalog_manager.cc:4985] TS fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947): tablet 4c649579f0f94f23aca3eafa7d81df2e (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:27.626070 24812 raft_consensus.cc:1064] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4: attempting to promote NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b to VOTER
I20251214 21:03:27.626519 24812 consensus_queue.cc:237] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 28, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:27.627740 24471 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:27.627810 23997 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:27.627844 24145 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:27.628069 24834 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:27.628253 24836 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:27.628379 24812 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:27.630076 24834 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.30: config changed from index 28 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.630569 24145 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 28 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.630653 23997 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 28 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.632226 24471 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 28 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.633047 23887 catalog_manager.cc:5654] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index 28 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.635944 24073 consensus_queue.cc:237] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 2.30, Last appended by leader: 28, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:27.636946 24145 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:27.636968 24471 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:27.637301 24837 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:27.637606 24837 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:27.638648 24836 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.639091 24471 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.640303 23883 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d246d019db6f483dab560d45620c2aec with cas_config_opid_index 30: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:27.640870 23889 catalog_manager.cc:5654] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: config changed from index 30 to 31, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.641125 24145 raft_consensus.cc:2955] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:27.642923 23989 tablet_service.cc:1552] Processing DeleteTablet for tablet d246d019db6f483dab560d45620c2aec with delete_type TABLET_DATA_TOMBSTONED (TS 126ee409f2314ba091e87159b26c0c62 not found in new config with opid_index 31) from {username='slave'} at 127.0.0.1:50476
I20251214 21:03:27.643128 24828 tablet_replica.cc:333] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:27.643262 24828 raft_consensus.cc:2243] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:27.643420 24828 raft_consensus.cc:2272] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:27.643939 24828 ts_tablet_manager.cc:1916] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:27.645553 24828 ts_tablet_manager.cc:1929] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.30
I20251214 21:03:27.645612 24828 log.cc:1199] T d246d019db6f483dab560d45620c2aec P 126ee409f2314ba091e87159b26c0c62: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/d246d019db6f483dab560d45620c2aec
I20251214 21:03:27.646023 23881 catalog_manager.cc:4985] TS 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681): tablet d246d019db6f483dab560d45620c2aec (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:28.310765 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:28.312656 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:28.312845 23997 raft_consensus.cc:606] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Received request to transfer leadership to TS a52fd6dfbfc440b19b28bcd675e1d210
I20251214 21:03:28.313761 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d246d019db6f483dab560d45620c2aec"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:28.313884 24068 raft_consensus.cc:606] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership to TS fe19ae24b84b428e8559931c04f1a6b2
I20251214 21:03:28.314734 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:28.314846 24068 raft_consensus.cc:606] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:28.315148 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20251214 21:03:28.315279 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:28.384783 24772 raft_consensus.cc:993] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower a52fd6dfbfc440b19b28bcd675e1d210 to start an election
I20251214 21:03:28.384898 24772 raft_consensus.cc:1081] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Signalling peer a52fd6dfbfc440b19b28bcd675e1d210 to start an election
I20251214 21:03:28.385303 24546 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884"
dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
from {username='slave'} at 127.0.0.1:48996
I20251214 21:03:28.385429 24546 raft_consensus.cc:493] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:28.385470 24546 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:28.387915 24546 raft_consensus.cc:515] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:28.388346 24546 leader_election.cc:290] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [CANDIDATE]: Term 4 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087)
I20251214 21:03:28.388706 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" candidate_term: 4 candidate_status { last_received { term: 3 index: 32 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:28.388706 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14f65411fb9c45b0892ef02beae5b884" candidate_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" candidate_term: 4 candidate_status { last_received { term: 3 index: 32 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:28.388871 23997 raft_consensus.cc:3055] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Stepping down as leader of term 3
I20251214 21:03:28.388871 24068 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:28.388938 23997 raft_consensus.cc:740] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:28.389086 23997 consensus_queue.cc:260] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 3.32, Last appended by leader: 32, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:28.389266 23997 raft_consensus.cc:3060] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:28.390004 24068 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a52fd6dfbfc440b19b28bcd675e1d210 in term 4.
I20251214 21:03:28.390179 23997 raft_consensus.cc:2468] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a52fd6dfbfc440b19b28bcd675e1d210 in term 4.
I20251214 21:03:28.390340 24512 leader_election.cc:304] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:28.390563 24806 raft_consensus.cc:2804] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Leader election won for term 4
I20251214 21:03:28.390738 24806 raft_consensus.cc:697] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 LEADER]: Becoming Leader. State: Replica: a52fd6dfbfc440b19b28bcd675e1d210, State: Running, Role: LEADER
I20251214 21:03:28.391002 24806 consensus_queue.cc:237] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 3.32, Last appended by leader: 32, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:28.392604 23894 catalog_manager.cc:5654] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 reported cstate change: term changed from 3 to 4, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6). New cstate: current_term: 4 leader_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:28.613888 24834 raft_consensus.cc:993] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:28.614001 24834 raft_consensus.cc:1081] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:28.614542 23997 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50500
I20251214 21:03:28.614691 23997 raft_consensus.cc:493] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:28.614751 23997 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:28.615681 23997 raft_consensus.cc:515] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:28.616014 23997 leader_election.cc:290] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 2 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:28.616338 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:28.616345 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:28.616437 24068 raft_consensus.cc:3055] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:28.616479 24145 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:28.616479 24068 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:28.616648 24068 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 27, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:28.616788 24068 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:28.617313 24145 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 2.
I20251214 21:03:28.617486 24068 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 2.
I20251214 21:03:28.617602 23964 leader_election.cc:304] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:28.617790 24772 raft_consensus.cc:2804] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:28.617875 24772 raft_consensus.cc:697] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:28.617995 24772 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 27, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:28.619398 23894 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 1 to 2, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 2 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
W20251214 21:03:28.644266 23944 auto_rebalancer.cc:253] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
W20251214 21:03:28.645267 23944 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d9efc0482ebe4a30a7b08b9190e72cdf, TS 68bf8595326044d78e9d47fe858479d4 -> TS b4706a6e7f19453ebb19fbfb8ef7558b move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
W20251214 21:03:28.645321 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet d9efc0482ebe4a30a7b08b9190e72cdf, TS 68bf8595326044d78e9d47fe858479d4 -> TS b4706a6e7f19453ebb19fbfb8ef7558b move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
W20251214 21:03:28.646163 23944 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 0d4b592c0409483384330ac5cfcbe8b5, TS 68bf8595326044d78e9d47fe858479d4 -> TS f0fd707333e94628b613b5d3387fc999 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
W20251214 21:03:28.646219 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 0d4b592c0409483384330ac5cfcbe8b5, TS 68bf8595326044d78e9d47fe858479d4 -> TS f0fd707333e94628b613b5d3387fc999 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
W20251214 21:03:28.647049 23944 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f19d4d6bfd10472094bb7a6f81cd06b4, TS 126ee409f2314ba091e87159b26c0c62 -> TS a52fd6dfbfc440b19b28bcd675e1d210 move failed, destination replica disappeared from tablet's Raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
W20251214 21:03:28.647099 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet f19d4d6bfd10472094bb7a6f81cd06b4, TS 126ee409f2314ba091e87159b26c0c62 -> TS a52fd6dfbfc440b19b28bcd675e1d210 move failed, destination replica disappeared from tablet's Raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
W20251214 21:03:28.651368 23944 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 01da8ce246384c7cb83053adfcffe77a, TS fe19ae24b84b428e8559931c04f1a6b2 -> TS b4706a6e7f19453ebb19fbfb8ef7558b move failed, destination replica disappeared from tablet's Raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
W20251214 21:03:28.651435 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 01da8ce246384c7cb83053adfcffe77a, TS fe19ae24b84b428e8559931c04f1a6b2 -> TS b4706a6e7f19453ebb19fbfb8ef7558b move failed, destination replica disappeared from tablet's Raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
W20251214 21:03:28.652426 23944 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ab9fd25bf1604ae4a6c94a9fc07f32cd, TS 68bf8595326044d78e9d47fe858479d4 -> TS a52fd6dfbfc440b19b28bcd675e1d210 move failed, destination replica disappeared from tablet's Raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
W20251214 21:03:28.652484 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet ab9fd25bf1604ae4a6c94a9fc07f32cd, TS 68bf8595326044d78e9d47fe858479d4 -> TS a52fd6dfbfc440b19b28bcd675e1d210 move failed, destination replica disappeared from tablet's Raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
W20251214 21:03:28.653481 23944 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d246d019db6f483dab560d45620c2aec, TS fe19ae24b84b428e8559931c04f1a6b2 -> TS f0fd707333e94628b613b5d3387fc999 move failed, destination replica disappeared from tablet's Raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
W20251214 21:03:28.653627 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet d246d019db6f483dab560d45620c2aec, TS fe19ae24b84b428e8559931c04f1a6b2 -> TS f0fd707333e94628b613b5d3387fc999 move failed, destination replica disappeared from tablet's Raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:28.674465 24834 raft_consensus.cc:993] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4: : Instructing follower fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:28.674597 24834 raft_consensus.cc:1081] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Signalling peer fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:28.675009 24145 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d246d019db6f483dab560d45620c2aec"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:37124
I20251214 21:03:28.675130 24145 raft_consensus.cc:493] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:28.675190 24145 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:28.676010 24145 raft_consensus.cc:515] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:28.676345 24145 leader_election.cc:290] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 3 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823)
I20251214 21:03:28.676600 24471 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d246d019db6f483dab560d45620c2aec" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 31 } } ignore_live_leader: true dest_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
I20251214 21:03:28.676600 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d246d019db6f483dab560d45620c2aec" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 31 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:28.676741 24471 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:28.676779 24068 raft_consensus.cc:3055] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:28.676824 24068 raft_consensus.cc:740] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:28.676954 24068 consensus_queue.cc:260] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 31, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:28.677117 24068 raft_consensus.cc:3060] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:28.677752 24471 raft_consensus.cc:2468] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 3.
I20251214 21:03:28.678030 24113 leader_election.cc:304] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4706a6e7f19453ebb19fbfb8ef7558b, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:28.678030 24068 raft_consensus.cc:2468] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 3.
I20251214 21:03:28.678292 24771 raft_consensus.cc:2804] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:28.678458 24771 raft_consensus.cc:697] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:28.678580 24771 consensus_queue.cc:237] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 31, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:28.679957 23896 catalog_manager.cc:5654] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 2 to 3, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 3 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:28.977958 24068 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Refusing update from remote peer a52fd6dfbfc440b19b28bcd675e1d210: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 4 index: 33. (index mismatch)
I20251214 21:03:28.978387 24806 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:28.981150 23997 raft_consensus.cc:1275] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Refusing update from remote peer a52fd6dfbfc440b19b28bcd675e1d210: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 4 index: 33. (index mismatch)
I20251214 21:03:28.981513 24806 consensus_queue.cc:1048] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:29.094314 24471 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251214 21:03:29.094748 24771 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:29.097533 24068 raft_consensus.cc:1275] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251214 21:03:29.097939 24850 consensus_queue.cc:1048] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:29.180410 24068 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251214 21:03:29.180800 24772 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:29.183061 24145 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 2 index: 28. (index mismatch)
I20251214 21:03:29.183465 24865 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:29.657157 24471 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 3.35, Last appended by leader: 32, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:29.658680 24546 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 35. Preceding OpId from leader: term: 3 index: 36. (index mismatch)
I20251214 21:03:29.658802 24068 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 35. Preceding OpId from leader: term: 3 index: 36. (index mismatch)
I20251214 21:03:29.659024 24829 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20251214 21:03:29.659288 24871 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20251214 21:03:29.660673 24829 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Committing config change with OpId 3.36: config changed from index 35 to 36, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
W20251214 21:03:29.662099 24435 consensus_peers.cc:597] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b -> Peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145): Couldn't send request to peer f0fd707333e94628b613b5d3387fc999. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c649579f0f94f23aca3eafa7d81df2e. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:29.662364 24546 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Committing config change with OpId 3.36: config changed from index 35 to 36, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:29.663100 24145 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 3.32, Last appended by leader: 29, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:29.663509 24068 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Committing config change with OpId 3.36: config changed from index 35 to 36, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:29.664040 23894 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: config changed from index 35 to 36, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:29.664707 23997 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:29.664714 24395 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:29.665397 24850 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:29.665683 24850 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:29.667172 24771 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Committing config change with OpId 3.33: config changed from index 32 to 33, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:29.667495 24395 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Committing config change with OpId 3.33: config changed from index 32 to 33, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:29.668586 23997 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Committing config change with OpId 3.33: config changed from index 32 to 33, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:29.670396 24395 consensus_queue.cc:237] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 30, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:29.670527 23896 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 reported cstate change: config changed from index 32 to 33, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New cstate: current_term: 3 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:29.671890 23997 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251214 21:03:29.672228 24886 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:29.672905 24145 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
W20251214 21:03:29.673287 24116 consensus_peers.cc:597] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f19d4d6bfd10472094bb7a6f81cd06b4. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:29.673480 24821 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:29.675088 24821 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 2 LEADER]: Committing config change with OpId 2.32: config changed from index 30 to 32, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:29.675439 23997 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.32: config changed from index 30 to 32, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:29.677002 24145 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.32: config changed from index 30 to 32, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
W20251214 21:03:29.677157 24358 consensus_peers.cc:597] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 -> Peer b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823): Couldn't send request to peer b4706a6e7f19453ebb19fbfb8ef7558b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01da8ce246384c7cb83053adfcffe77a. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:29.677559 23889 catalog_manager.cc:5654] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 30 to 32, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New cstate: current_term: 2 leader_uuid: "f0fd707333e94628b613b5d3387fc999" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:29.677947 23997 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 2.28, Last appended by leader: 27, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:29.679176 24068 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
I20251214 21:03:29.679243 24145 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 2 index: 29. (index mismatch)
W20251214 21:03:29.679327 23965 consensus_peers.cc:597] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9efc0482ebe4a30a7b08b9190e72cdf. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:29.679560 24864 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:29.679690 24865 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:29.681437 24772 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Committing config change with OpId 2.29: config changed from index -1 to 29, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:29.681885 24145 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.29: config changed from index -1 to 29, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:29.683166 24068 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Committing config change with OpId 2.29: config changed from index -1 to 29, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } } }
I20251214 21:03:29.683785 24150 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:29.683775 23896 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index -1 to 29, NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) added. New cstate: current_term: 2 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:29.684995 24471 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20251214 21:03:29.685329 24861 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:29.685554 24068 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20251214 21:03:29.686475 24861 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
W20251214 21:03:29.686786 24114 consensus_peers.cc:597] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 -> Peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145): Couldn't send request to peer f0fd707333e94628b613b5d3387fc999. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab9fd25bf1604ae4a6c94a9fc07f32cd. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:29.687870 24850 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:29.689252 24471 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:29.689971 24068 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } } }
I20251214 21:03:29.690044 23997 consensus_queue.cc:237] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:29.691177 23894 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index 30 to 31, NON_VOTER f0fd707333e94628b613b5d3387fc999 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:29.691668 24145 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:29.691668 24395 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20251214 21:03:29.692540 24772 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:29.692838 24772 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20251214 21:03:29.694643 24772 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:29.694924 24145 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:29.696587 24395 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } } }
I20251214 21:03:29.696671 23894 catalog_manager.cc:5654] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 28 to 29, NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) added. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:03:29.699276 23962 consensus_peers.cc:597] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 -> Peer b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823): Couldn't send request to peer b4706a6e7f19453ebb19fbfb8ef7558b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d13b1d13a93d4cc3940537b29baf147a. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:30.128026 24899 ts_tablet_manager.cc:933] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: Initiating tablet copy from peer b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823)
I20251214 21:03:30.128376 24899 tablet_copy_client.cc:323] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.5:46823
I20251214 21:03:30.128782 24481 tablet_copy_service.cc:140] P b4706a6e7f19453ebb19fbfb8ef7558b: Received BeginTabletCopySession request for tablet 4c649579f0f94f23aca3eafa7d81df2e from peer f0fd707333e94628b613b5d3387fc999 ({username='slave'} at 127.0.0.1:41430)
I20251214 21:03:30.128887 24481 tablet_copy_service.cc:161] P b4706a6e7f19453ebb19fbfb8ef7558b: Beginning new tablet copy session on tablet 4c649579f0f94f23aca3eafa7d81df2e from peer f0fd707333e94628b613b5d3387fc999 at {username='slave'} at 127.0.0.1:41430: session id = f0fd707333e94628b613b5d3387fc999-4c649579f0f94f23aca3eafa7d81df2e
I20251214 21:03:30.130048 24481 tablet_copy_source_session.cc:215] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:30.130802 24899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c649579f0f94f23aca3eafa7d81df2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:30.133036 24899 tablet_copy_client.cc:806] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:30.133205 24899 tablet_copy_client.cc:670] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:30.134145 24900 tablet_copy_client.cc:1025] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:30.148245 24901 ts_tablet_manager.cc:933] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: Initiating tablet copy from peer 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681)
I20251214 21:03:30.148598 24901 tablet_copy_client.cc:323] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.1:39681
I20251214 21:03:30.152184 24009 tablet_copy_service.cc:140] P 126ee409f2314ba091e87159b26c0c62: Received BeginTabletCopySession request for tablet d13b1d13a93d4cc3940537b29baf147a from peer b4706a6e7f19453ebb19fbfb8ef7558b ({username='slave'} at 127.0.0.1:50312)
I20251214 21:03:30.152287 24009 tablet_copy_service.cc:161] P 126ee409f2314ba091e87159b26c0c62: Beginning new tablet copy session on tablet d13b1d13a93d4cc3940537b29baf147a from peer b4706a6e7f19453ebb19fbfb8ef7558b at {username='slave'} at 127.0.0.1:50312: session id = b4706a6e7f19453ebb19fbfb8ef7558b-d13b1d13a93d4cc3940537b29baf147a
I20251214 21:03:30.153121 24009 tablet_copy_source_session.cc:215] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:30.153900 24901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13b1d13a93d4cc3940537b29baf147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:30.155859 24901 tablet_copy_client.cc:806] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:30.156023 24901 tablet_copy_client.cc:670] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:30.156993 24902 tablet_copy_client.cc:1025] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:30.241540 24904 ts_tablet_manager.cc:933] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: Initiating tablet copy from peer f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145)
I20251214 21:03:30.241921 24904 tablet_copy_client.cc:323] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.4:40145
I20251214 21:03:30.242311 24405 tablet_copy_service.cc:140] P f0fd707333e94628b613b5d3387fc999: Received BeginTabletCopySession request for tablet 01da8ce246384c7cb83053adfcffe77a from peer b4706a6e7f19453ebb19fbfb8ef7558b ({username='slave'} at 127.0.0.1:42780)
I20251214 21:03:30.242396 24405 tablet_copy_service.cc:161] P f0fd707333e94628b613b5d3387fc999: Beginning new tablet copy session on tablet 01da8ce246384c7cb83053adfcffe77a from peer b4706a6e7f19453ebb19fbfb8ef7558b at {username='slave'} at 127.0.0.1:42780: session id = b4706a6e7f19453ebb19fbfb8ef7558b-01da8ce246384c7cb83053adfcffe77a
I20251214 21:03:30.243422 24405 tablet_copy_source_session.cc:215] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:30.244156 24904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01da8ce246384c7cb83053adfcffe77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:30.246097 24904 tablet_copy_client.cc:806] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:30.246248 24904 tablet_copy_client.cc:670] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:30.247218 24905 tablet_copy_client.cc:1025] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:30.264971 24906 ts_tablet_manager.cc:933] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: Initiating tablet copy from peer fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:30.265290 24906 tablet_copy_client.cc:323] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:32947
I20251214 21:03:30.269269 24160 tablet_copy_service.cc:140] P fe19ae24b84b428e8559931c04f1a6b2: Received BeginTabletCopySession request for tablet f19d4d6bfd10472094bb7a6f81cd06b4 from peer a52fd6dfbfc440b19b28bcd675e1d210 ({username='slave'} at 127.0.0.1:60416)
I20251214 21:03:30.269389 24160 tablet_copy_service.cc:161] P fe19ae24b84b428e8559931c04f1a6b2: Beginning new tablet copy session on tablet f19d4d6bfd10472094bb7a6f81cd06b4 from peer a52fd6dfbfc440b19b28bcd675e1d210 at {username='slave'} at 127.0.0.1:60416: session id = a52fd6dfbfc440b19b28bcd675e1d210-f19d4d6bfd10472094bb7a6f81cd06b4
I20251214 21:03:30.270318 24160 tablet_copy_source_session.cc:215] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:30.271064 24906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19d4d6bfd10472094bb7a6f81cd06b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:30.273031 24906 tablet_copy_client.cc:806] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:30.273177 24906 tablet_copy_client.cc:670] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:30.274292 24907 tablet_copy_client.cc:1025] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:30.274374 24910 ts_tablet_manager.cc:933] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: Initiating tablet copy from peer fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:30.274684 24910 tablet_copy_client.cc:323] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:32947
I20251214 21:03:30.275044 24160 tablet_copy_service.cc:140] P fe19ae24b84b428e8559931c04f1a6b2: Received BeginTabletCopySession request for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd from peer f0fd707333e94628b613b5d3387fc999 ({username='slave'} at 127.0.0.1:37170)
I20251214 21:03:30.275128 24160 tablet_copy_service.cc:161] P fe19ae24b84b428e8559931c04f1a6b2: Beginning new tablet copy session on tablet ab9fd25bf1604ae4a6c94a9fc07f32cd from peer f0fd707333e94628b613b5d3387fc999 at {username='slave'} at 127.0.0.1:37170: session id = f0fd707333e94628b613b5d3387fc999-ab9fd25bf1604ae4a6c94a9fc07f32cd
I20251214 21:03:30.275933 24160 tablet_copy_source_session.cc:215] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:30.276657 24910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:30.278741 24910 tablet_copy_client.cc:806] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:30.278898 24910 tablet_copy_client.cc:670] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:30.279796 24911 tablet_copy_client.cc:1025] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:30.290751 24912 ts_tablet_manager.cc:933] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: Initiating tablet copy from peer 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681)
I20251214 21:03:30.291155 24912 tablet_copy_client.cc:323] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.1:39681
I20251214 21:03:30.291585 24009 tablet_copy_service.cc:140] P 126ee409f2314ba091e87159b26c0c62: Received BeginTabletCopySession request for tablet d9efc0482ebe4a30a7b08b9190e72cdf from peer a52fd6dfbfc440b19b28bcd675e1d210 ({username='slave'} at 127.0.0.1:50536)
I20251214 21:03:30.291677 24009 tablet_copy_service.cc:161] P 126ee409f2314ba091e87159b26c0c62: Beginning new tablet copy session on tablet d9efc0482ebe4a30a7b08b9190e72cdf from peer a52fd6dfbfc440b19b28bcd675e1d210 at {username='slave'} at 127.0.0.1:50536: session id = a52fd6dfbfc440b19b28bcd675e1d210-d9efc0482ebe4a30a7b08b9190e72cdf
I20251214 21:03:30.292586 24009 tablet_copy_source_session.cc:215] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:30.293345 24912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9efc0482ebe4a30a7b08b9190e72cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:30.295464 24912 tablet_copy_client.cc:806] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:30.295611 24912 tablet_copy_client.cc:670] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:30.296509 24913 tablet_copy_client.cc:1025] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Injecting latency into file download: 2000
I20251214 21:03:30.315527 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:30.317219 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:30.317348 23997 raft_consensus.cc:606] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:30.318056 24145 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:37144
I20251214 21:03:30.318254 24145 raft_consensus.cc:606] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:30.318601 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251214 21:03:30.318724 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:30.695884 24850 raft_consensus.cc:993] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:30.696008 24850 raft_consensus.cc:1081] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:30.696373 23998 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50490
I20251214 21:03:30.696497 23998 raft_consensus.cc:493] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:30.696560 23998 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:30.697731 23998 raft_consensus.cc:515] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:30.698079 23998 leader_election.cc:290] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 4 election: Requested vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145)
I20251214 21:03:30.698541 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 4 candidate_status { last_received { term: 3 index: 33 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:30.698652 24145 raft_consensus.cc:3055] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Stepping down as leader of term 3
I20251214 21:03:30.698681 24145 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:30.698786 24395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 4 candidate_status { last_received { term: 3 index: 33 } } ignore_live_leader: true dest_uuid: "f0fd707333e94628b613b5d3387fc999"
I20251214 21:03:30.698792 24145 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 3.33, Last appended by leader: 33, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:30.698890 24395 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:30.699013 24145 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:30.699770 24395 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 4.
I20251214 21:03:30.700027 24145 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 4.
I20251214 21:03:30.700081 23963 leader_election.cc:304] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, f0fd707333e94628b613b5d3387fc999; no voters:
I20251214 21:03:30.700243 24917 raft_consensus.cc:2804] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Leader election won for term 4
I20251214 21:03:30.700323 24917 raft_consensus.cc:697] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:30.700441 24917 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 3.33, Last appended by leader: 33, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:30.701975 23889 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 3 to 4, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 4 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:30.707250 23998 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:50476
I20251214 21:03:30.707357 23998 raft_consensus.cc:606] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Received request to transfer leadership
I20251214 21:03:30.712051 23998 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:50476
I20251214 21:03:30.712183 23998 raft_consensus.cc:606] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Received request to transfer leadership
W20251214 21:03:30.712425 23881 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for f19d4d6bfd10472094bb7a6f81cd06b4 already in progress
I20251214 21:03:30.713135 23998 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:50476
I20251214 21:03:30.713241 23998 raft_consensus.cc:606] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Received request to transfer leadership
W20251214 21:03:30.713552 23944 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for f19d4d6bfd10472094bb7a6f81cd06b4 already in progress
W20251214 21:03:30.713616 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f19d4d6bfd10472094bb7a6f81cd06b4 already in progress
I20251214 21:03:30.837461 24865 raft_consensus.cc:993] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:30.837591 24865 raft_consensus.cc:1081] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:30.837992 24068 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57968
I20251214 21:03:30.838124 24068 raft_consensus.cc:493] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:30.838191 24068 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:30.839223 24068 raft_consensus.cc:515] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:30.839568 24068 leader_election.cc:290] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 3 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:30.839776 23998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 27 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:30.839857 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d4b592c0409483384330ac5cfcbe8b5" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 27 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:30.839871 23998 raft_consensus.cc:3055] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:30.839969 23998 raft_consensus.cc:740] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:30.839982 24145 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:30.840099 23998 consensus_queue.cc:260] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 27, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:30.840235 23998 raft_consensus.cc:3060] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:30.840934 24145 raft_consensus.cc:2468] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 3.
I20251214 21:03:30.841068 23998 raft_consensus.cc:2468] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 3.
I20251214 21:03:30.841185 24040 leader_election.cc:304] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:30.841344 24834 raft_consensus.cc:2804] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:30.841497 24834 raft_consensus.cc:697] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 3 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:30.841614 24834 consensus_queue.cc:237] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 2.27, Last appended by leader: 27, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } }
I20251214 21:03:30.843137 23889 catalog_manager.cc:5654] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 2 to 3, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 3 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:31.079337 24145 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 4 index: 34. (index mismatch)
I20251214 21:03:31.079710 24865 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:31.081218 24916 raft_consensus.cc:993] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:31.081315 24916 raft_consensus.cc:1081] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Signalling peer fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:31.081863 24150 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:37122
W20251214 21:03:31.082346 23965 consensus_peers.cc:597] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:31.082370 24394 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 4 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 4 index: 34. (index mismatch)
I20251214 21:03:31.082520 24150 raft_consensus.cc:493] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:31.082587 24150 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:31.082755 24917 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:31.083652 24150 raft_consensus.cc:515] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:31.083940 24150 leader_election.cc:290] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 5 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), f0fd707333e94628b613b5d3387fc999 (127.20.32.4:40145)
I20251214 21:03:31.084307 24395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 34 } } ignore_live_leader: true dest_uuid: "f0fd707333e94628b613b5d3387fc999"
I20251214 21:03:31.084836 23998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f19d4d6bfd10472094bb7a6f81cd06b4" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 34 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:31.085018 23998 raft_consensus.cc:3055] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Stepping down as leader of term 4
I20251214 21:03:31.085070 23998 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:31.085230 23998 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 4.34, Last appended by leader: 34, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:31.085665 23998 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:31.086876 23998 raft_consensus.cc:2468] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 5.
I20251214 21:03:31.087109 24114 leader_election.cc:304] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, fe19ae24b84b428e8559931c04f1a6b2; no voters: f0fd707333e94628b613b5d3387fc999
I20251214 21:03:31.087283 24927 raft_consensus.cc:2804] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 5 FOLLOWER]: Leader election won for term 5
I20251214 21:03:31.087366 24927 raft_consensus.cc:697] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:31.087499 24927 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 4.34, Last appended by leader: 34, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:31.088747 23896 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 4 to 5, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 5 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:31.334245 23997 raft_consensus.cc:1275] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 3 index: 28. (index mismatch)
I20251214 21:03:31.334652 24834 consensus_queue.cc:1048] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20251214 21:03:31.337427 24150 raft_consensus.cc:1275] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 27. Preceding OpId from leader: term: 3 index: 28. (index mismatch)
I20251214 21:03:31.337945 24928 consensus_queue.cc:1048] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
W20251214 21:03:31.571650 24116 consensus_peers.cc:597] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 -> Peer a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351): Couldn't send request to peer a52fd6dfbfc440b19b28bcd675e1d210. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:31.680691 23998 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 34. Preceding OpId from leader: term: 5 index: 35. (index mismatch)
I20251214 21:03:31.681051 24918 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:31.683738 24394 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:31.684953 24394 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 5 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 34. Preceding OpId from leader: term: 5 index: 35. (index mismatch)
I20251214 21:03:31.685281 24940 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:32.134404 24899 tablet_copy_client.cc:538] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:32.135910 24899 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: Bootstrap starting.
I20251214 21:03:32.157231 24901 tablet_copy_client.cc:538] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:32.158799 24901 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap starting.
I20251214 21:03:32.160435 24899 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: Bootstrap replayed 1/1 log segments. Stats: ops{read=36 overwritten=0 applied=36 ignored=0} inserts{seen=109 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:32.160677 24899 tablet_bootstrap.cc:492] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: Bootstrap complete.
I20251214 21:03:32.160861 24899 ts_tablet_manager.cc:1403] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: Time spent bootstrapping tablet: real 0.025s user 0.018s sys 0.005s
I20251214 21:03:32.161315 24899 raft_consensus.cc:359] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:32.161572 24899 raft_consensus.cc:740] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f0fd707333e94628b613b5d3387fc999, State: Initialized, Role: LEARNER
I20251214 21:03:32.161692 24899 consensus_queue.cc:260] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 36, Last appended: 3.36, Last appended by leader: 36, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:32.162039 24899 ts_tablet_manager.cc:1434] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20251214 21:03:32.162571 24481 tablet_copy_service.cc:342] P b4706a6e7f19453ebb19fbfb8ef7558b: Request end of tablet copy session f0fd707333e94628b613b5d3387fc999-4c649579f0f94f23aca3eafa7d81df2e received from {username='slave'} at 127.0.0.1:41430
I20251214 21:03:32.162652 24481 tablet_copy_service.cc:434] P b4706a6e7f19453ebb19fbfb8ef7558b: ending tablet copy session f0fd707333e94628b613b5d3387fc999-4c649579f0f94f23aca3eafa7d81df2e on tablet 4c649579f0f94f23aca3eafa7d81df2e with peer f0fd707333e94628b613b5d3387fc999
I20251214 21:03:32.180084 24901 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap replayed 1/1 log segments. Stats: ops{read=29 overwritten=0 applied=29 ignored=0} inserts{seen=94 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:32.180395 24901 tablet_bootstrap.cc:492] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap complete.
I20251214 21:03:32.180589 24901 ts_tablet_manager.cc:1403] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent bootstrapping tablet: real 0.022s user 0.016s sys 0.003s
I20251214 21:03:32.181100 24901 raft_consensus.cc:359] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:32.181223 24901 raft_consensus.cc:740] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b4706a6e7f19453ebb19fbfb8ef7558b, State: Initialized, Role: LEARNER
I20251214 21:03:32.181301 24901 consensus_queue.cc:260] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 29, Last appended: 1.29, Last appended by leader: 29, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:32.181574 24901 ts_tablet_manager.cc:1434] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:32.181995 24009 tablet_copy_service.cc:342] P 126ee409f2314ba091e87159b26c0c62: Request end of tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-d13b1d13a93d4cc3940537b29baf147a received from {username='slave'} at 127.0.0.1:50312
I20251214 21:03:32.182073 24009 tablet_copy_service.cc:434] P 126ee409f2314ba091e87159b26c0c62: ending tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-d13b1d13a93d4cc3940537b29baf147a on tablet d13b1d13a93d4cc3940537b29baf147a with peer b4706a6e7f19453ebb19fbfb8ef7558b
I20251214 21:03:32.247556 24904 tablet_copy_client.cc:538] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:32.249157 24904 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap starting.
I20251214 21:03:32.274586 24906 tablet_copy_client.cc:538] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:32.274649 24904 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap replayed 1/1 log segments. Stats: ops{read=32 overwritten=0 applied=32 ignored=0} inserts{seen=122 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:32.274895 24904 tablet_bootstrap.cc:492] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: Bootstrap complete.
I20251214 21:03:32.275126 24904 ts_tablet_manager.cc:1403] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent bootstrapping tablet: real 0.026s user 0.020s sys 0.007s
I20251214 21:03:32.275693 24904 raft_consensus.cc:359] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:32.275856 24904 raft_consensus.cc:740] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b4706a6e7f19453ebb19fbfb8ef7558b, State: Initialized, Role: LEARNER
I20251214 21:03:32.275987 24904 consensus_queue.cc:260] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 32, Last appended: 2.32, Last appended by leader: 32, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: NON_VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: true } }
I20251214 21:03:32.276239 24906 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap starting.
I20251214 21:03:32.276288 24904 ts_tablet_manager.cc:1434] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:32.276722 24405 tablet_copy_service.cc:342] P f0fd707333e94628b613b5d3387fc999: Request end of tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-01da8ce246384c7cb83053adfcffe77a received from {username='slave'} at 127.0.0.1:42780
I20251214 21:03:32.276803 24405 tablet_copy_service.cc:434] P f0fd707333e94628b613b5d3387fc999: ending tablet copy session b4706a6e7f19453ebb19fbfb8ef7558b-01da8ce246384c7cb83053adfcffe77a on tablet 01da8ce246384c7cb83053adfcffe77a with peer b4706a6e7f19453ebb19fbfb8ef7558b
I20251214 21:03:32.280050 24910 tablet_copy_client.cc:538] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:32.281543 24910 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: Bootstrap starting.
I20251214 21:03:32.287390 24394 raft_consensus.cc:1217] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.35->[3.36-3.36] Dedup: 3.36->[]
I20251214 21:03:32.296787 24912 tablet_copy_client.cc:538] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:32.298542 24912 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap starting.
I20251214 21:03:32.300513 24471 raft_consensus.cc:1217] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.28->[1.29-1.29] Dedup: 1.29->[]
I20251214 21:03:32.313654 24906 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap replayed 1/1 log segments. Stats: ops{read=33 overwritten=0 applied=33 ignored=0} inserts{seen=116 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:32.314340 24906 tablet_bootstrap.cc:492] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap complete.
I20251214 21:03:32.314621 24906 ts_tablet_manager.cc:1403] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: Time spent bootstrapping tablet: real 0.038s user 0.025s sys 0.001s
I20251214 21:03:32.315480 24906 raft_consensus.cc:359] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:32.315937 24906 raft_consensus.cc:740] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a52fd6dfbfc440b19b28bcd675e1d210, State: Initialized, Role: LEARNER
I20251214 21:03:32.316103 24906 consensus_queue.cc:260] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 33, Last appended: 3.33, Last appended by leader: 33, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:32.316809 24906 ts_tablet_manager.cc:1434] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251214 21:03:32.317267 24160 tablet_copy_service.cc:342] P fe19ae24b84b428e8559931c04f1a6b2: Request end of tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-f19d4d6bfd10472094bb7a6f81cd06b4 received from {username='slave'} at 127.0.0.1:60416
I20251214 21:03:32.317353 24160 tablet_copy_service.cc:434] P fe19ae24b84b428e8559931c04f1a6b2: ending tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-f19d4d6bfd10472094bb7a6f81cd06b4 on tablet f19d4d6bfd10472094bb7a6f81cd06b4 with peer a52fd6dfbfc440b19b28bcd675e1d210
I20251214 21:03:32.318948 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:32.320236 24910 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: Bootstrap replayed 1/1 log segments. Stats: ops{read=31 overwritten=0 applied=31 ignored=0} inserts{seen=99 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:32.320513 24910 tablet_bootstrap.cc:492] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: Bootstrap complete.
I20251214 21:03:32.320693 24910 ts_tablet_manager.cc:1403] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: Time spent bootstrapping tablet: real 0.039s user 0.020s sys 0.004s
I20251214 21:03:32.321038 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:32.321161 24068 raft_consensus.cc:606] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:32.321152 24910 raft_consensus.cc:359] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:32.321467 24910 raft_consensus.cc:740] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f0fd707333e94628b613b5d3387fc999, State: Initialized, Role: LEARNER
I20251214 21:03:32.321586 24910 consensus_queue.cc:260] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 31, Last appended: 1.31, Last appended by leader: 31, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:32.321943 24910 ts_tablet_manager.cc:1434] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:03:32.322477 24160 tablet_copy_service.cc:342] P fe19ae24b84b428e8559931c04f1a6b2: Request end of tablet copy session f0fd707333e94628b613b5d3387fc999-ab9fd25bf1604ae4a6c94a9fc07f32cd received from {username='slave'} at 127.0.0.1:37170
I20251214 21:03:32.322542 24145 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:37144
I20251214 21:03:32.322548 24160 tablet_copy_service.cc:434] P fe19ae24b84b428e8559931c04f1a6b2: ending tablet copy session f0fd707333e94628b613b5d3387fc999-ab9fd25bf1604ae4a6c94a9fc07f32cd on tablet ab9fd25bf1604ae4a6c94a9fc07f32cd with peer f0fd707333e94628b613b5d3387fc999
I20251214 21:03:32.322638 24145 raft_consensus.cc:606] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:32.322934 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20251214 21:03:32.323045 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:32.325109 24912 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap replayed 1/1 log segments. Stats: ops{read=29 overwritten=0 applied=29 ignored=0} inserts{seen=103 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:32.325353 24912 tablet_bootstrap.cc:492] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: Bootstrap complete.
I20251214 21:03:32.325511 24912 ts_tablet_manager.cc:1403] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: Time spent bootstrapping tablet: real 0.027s user 0.018s sys 0.005s
I20251214 21:03:32.325933 24912 raft_consensus.cc:359] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:32.326041 24912 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a52fd6dfbfc440b19b28bcd675e1d210, State: Initialized, Role: LEARNER
I20251214 21:03:32.326141 24912 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 29, Last appended: 2.29, Last appended by leader: 29, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true } }
I20251214 21:03:32.326403 24912 ts_tablet_manager.cc:1434] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:03:32.326884 24009 tablet_copy_service.cc:342] P 126ee409f2314ba091e87159b26c0c62: Request end of tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-d9efc0482ebe4a30a7b08b9190e72cdf received from {username='slave'} at 127.0.0.1:50536
I20251214 21:03:32.326956 24009 tablet_copy_service.cc:434] P 126ee409f2314ba091e87159b26c0c62: ending tablet copy session a52fd6dfbfc440b19b28bcd675e1d210-d9efc0482ebe4a30a7b08b9190e72cdf on tablet d9efc0482ebe4a30a7b08b9190e72cdf with peer a52fd6dfbfc440b19b28bcd675e1d210
I20251214 21:03:32.361215 24546 raft_consensus.cc:1217] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.28->[2.29-2.29] Dedup: 2.29->[]
I20251214 21:03:32.362797 24471 raft_consensus.cc:1217] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.31->[2.32-2.32] Dedup: 2.32->[]
I20251214 21:03:32.536185 24947 raft_consensus.cc:993] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:32.536329 24940 raft_consensus.cc:1081] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:32.536792 24068 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57956
I20251214 21:03:32.536954 24068 raft_consensus.cc:493] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:32.537022 24068 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:32.537884 24068 raft_consensus.cc:515] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:32.538275 24068 leader_election.cc:290] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Requested vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5:46823)
I20251214 21:03:32.538583 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:32.538681 24150 raft_consensus.cc:3055] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:32.538723 24150 raft_consensus.cc:740] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:32.538854 24150 consensus_queue.cc:260] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 31, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:32.539050 24150 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:32.539866 24150 raft_consensus.cc:2468] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:32.540158 24040 leader_election.cc:304] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:32.540248 24471 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: true dest_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
I20251214 21:03:32.540347 24943 raft_consensus.cc:2804] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:32.540360 24471 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:32.540557 24943 raft_consensus.cc:697] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:32.540701 24943 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 31, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:32.541317 24471 raft_consensus.cc:2468] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 2.
I20251214 21:03:32.542627 23896 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 1 to 2, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:32.549057 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:32.549201 24068 raft_consensus.cc:606] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership
I20251214 21:03:32.553457 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:32.553596 24068 raft_consensus.cc:606] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership
I20251214 21:03:32.554517 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:32.554641 24068 raft_consensus.cc:606] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Received request to transfer leadership
W20251214 21:03:32.554908 23944 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for ab9fd25bf1604ae4a6c94a9fc07f32cd already in progress
W20251214 21:03:32.554963 23944 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ab9fd25bf1604ae4a6c94a9fc07f32cd already in progress
I20251214 21:03:32.623468 24951 raft_consensus.cc:993] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:32.623600 24951 raft_consensus.cc:1081] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:32.624020 23998 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50500
I20251214 21:03:32.624171 23998 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:32.624238 23998 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:32.625319 23998 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:32.625885 23998 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 5 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:32.626190 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 5 candidate_status { last_received { term: 4 index: 29 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:32.626197 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 5 candidate_status { last_received { term: 4 index: 29 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:32.626312 24068 raft_consensus.cc:3055] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Stepping down as leader of term 4
I20251214 21:03:32.626312 24546 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:32.626397 24068 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:32.626528 24068 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 4.29, Last appended by leader: 29, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:32.626696 24068 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:32.627406 24546 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 5.
I20251214 21:03:32.627580 24068 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 5.
I20251214 21:03:32.627686 23965 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:32.627950 24917 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Leader election won for term 5
I20251214 21:03:32.628163 24917 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 5 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:32.628306 24917 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 4.29, Last appended by leader: 29, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:32.630178 23896 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 4 to 5, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 5 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:32.642292 24546 raft_consensus.cc:3060] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 LEARNER]: Advancing to term 5
I20251214 21:03:32.643414 24546 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 LEARNER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 4 index: 34. (index mismatch)
I20251214 21:03:32.643782 24940 consensus_queue.cc:1050] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: NON_VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:32.645946 24940 raft_consensus.cc:1064] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: attempting to promote NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 to VOTER
I20251214 21:03:32.646363 24940 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 5.35, Last appended by leader: 34, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:32.647686 24394 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 5 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 35. Preceding OpId from leader: term: 5 index: 36. (index mismatch)
I20251214 21:03:32.647909 23998 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 35. Preceding OpId from leader: term: 5 index: 36. (index mismatch)
I20251214 21:03:32.648108 24546 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 LEARNER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 35. Preceding OpId from leader: term: 5 index: 36. (index mismatch)
I20251214 21:03:32.648590 24964 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20251214 21:03:32.648964 24963 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20251214 21:03:32.649091 24947 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20251214 21:03:32.650530 24964 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Committing config change with OpId 5.36: config changed from index 33 to 36, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.650924 24394 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 5 FOLLOWER]: Committing config change with OpId 5.36: config changed from index 33 to 36, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.650959 24546 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Committing config change with OpId 5.36: config changed from index 33 to 36, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.652948 23896 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 reported cstate change: config changed from index 33 to 36, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.653240 23998 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Committing config change with OpId 5.36: config changed from index 33 to 36, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.656258 24145 consensus_queue.cc:237] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 5.36, Last appended by leader: 34, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:32.657588 24546 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 36. Preceding OpId from leader: term: 5 index: 37. (index mismatch)
I20251214 21:03:32.657768 24395 raft_consensus.cc:1275] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 5 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 36. Preceding OpId from leader: term: 5 index: 37. (index mismatch)
I20251214 21:03:32.658046 24947 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20251214 21:03:32.658443 24947 consensus_queue.cc:1048] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20251214 21:03:32.659353 24964 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Committing config change with OpId 5.37: config changed from index 36 to 37, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.659742 24546 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Committing config change with OpId 5.37: config changed from index 36 to 37, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.660018 24395 raft_consensus.cc:2955] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 5 FOLLOWER]: Committing config change with OpId 5.37: config changed from index 36 to 37, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.661552 23882 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet f19d4d6bfd10472094bb7a6f81cd06b4 with cas_config_opid_index 36: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:32.662177 23894 catalog_manager.cc:5654] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 reported cstate change: config changed from index 36 to 37, VOTER 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) evicted. New cstate: current_term: 5 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.664227 23989 tablet_service.cc:1552] Processing DeleteTablet for tablet f19d4d6bfd10472094bb7a6f81cd06b4 with delete_type TABLET_DATA_TOMBSTONED (TS 126ee409f2314ba091e87159b26c0c62 not found in new config with opid_index 37) from {username='slave'} at 127.0.0.1:50476
I20251214 21:03:32.664705 24965 tablet_replica.cc:333] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:32.664842 24965 raft_consensus.cc:2243] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:32.665050 24965 raft_consensus.cc:2272] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:32.665625 24965 ts_tablet_manager.cc:1916] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:32.667840 24965 ts_tablet_manager.cc:1929] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.36
I20251214 21:03:32.667922 24965 log.cc:1199] T f19d4d6bfd10472094bb7a6f81cd06b4 P 126ee409f2314ba091e87159b26c0c62: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/f19d4d6bfd10472094bb7a6f81cd06b4
I20251214 21:03:32.668407 23881 catalog_manager.cc:4985] TS 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681): tablet f19d4d6bfd10472094bb7a6f81cd06b4 (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:32.845420 24967 raft_consensus.cc:1064] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
I20251214 21:03:32.845934 24967 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 3.36, Last appended by leader: 32, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:32.847540 24546 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 36. Preceding OpId from leader: term: 3 index: 37. (index mismatch)
I20251214 21:03:32.847514 24395 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 36. Preceding OpId from leader: term: 3 index: 37. (index mismatch)
I20251214 21:03:32.847527 24068 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 36. Preceding OpId from leader: term: 3 index: 37. (index mismatch)
I20251214 21:03:32.847975 24969 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20251214 21:03:32.848243 24936 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20251214 21:03:32.848703 24970 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20251214 21:03:32.850885 24936 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Committing config change with OpId 3.37: config changed from index 36 to 37, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:32.851256 24068 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Committing config change with OpId 3.37: config changed from index 36 to 37, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:32.853295 23896 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: config changed from index 36 to 37, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:32.854357 24395 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Committing config change with OpId 3.37: config changed from index 36 to 37, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:32.856324 24546 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Committing config change with OpId 3.37: config changed from index 36 to 37, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:32.857425 24471 consensus_queue.cc:237] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 37, Committed index: 37, Last appended: 3.37, Last appended by leader: 32, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:32.858682 24546 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 37. Preceding OpId from leader: term: 3 index: 38. (index mismatch)
I20251214 21:03:32.858749 24395 raft_consensus.cc:1275] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 37. Preceding OpId from leader: term: 3 index: 38. (index mismatch)
I20251214 21:03:32.859035 24966 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 37, Time since last communication: 0.000s
I20251214 21:03:32.859210 24969 consensus_queue.cc:1048] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 37, Time since last communication: 0.000s
I20251214 21:03:32.860553 24967 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Committing config change with OpId 3.38: config changed from index 37 to 38, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:32.860898 24394 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Committing config change with OpId 3.38: config changed from index 37 to 38, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:32.862423 23939 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4c649579f0f94f23aca3eafa7d81df2e with cas_config_opid_index 37: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:32.862618 24546 raft_consensus.cc:2955] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Committing config change with OpId 3.38: config changed from index 37 to 38, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:32.863133 23889 catalog_manager.cc:5654] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: config changed from index 37 to 38, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:32.865557 24056 tablet_service.cc:1552] Processing DeleteTablet for tablet 4c649579f0f94f23aca3eafa7d81df2e with delete_type TABLET_DATA_TOMBSTONED (TS 68bf8595326044d78e9d47fe858479d4 not found in new config with opid_index 38) from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:32.866052 24974 tablet_replica.cc:333] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:32.866221 24974 raft_consensus.cc:2243] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:32.866437 24974 raft_consensus.cc:2272] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:32.867125 24974 ts_tablet_manager.cc:1916] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:32.870036 24974 ts_tablet_manager.cc:1929] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.37
I20251214 21:03:32.870136 24974 log.cc:1199] T 4c649579f0f94f23aca3eafa7d81df2e P 68bf8595326044d78e9d47fe858479d4: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/4c649579f0f94f23aca3eafa7d81df2e
I20251214 21:03:32.870611 23883 catalog_manager.cc:4985] TS 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): tablet 4c649579f0f94f23aca3eafa7d81df2e (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:32.883780 24975 raft_consensus.cc:1064] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: attempting to promote NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b to VOTER
I20251214 21:03:32.884260 24975 consensus_queue.cc:237] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:32.885792 24471 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 LEARNER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:32.885792 24394 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:32.886140 24958 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:32.886328 24145 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20251214 21:03:32.886478 24958 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:32.886804 24917 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:32.888269 24975 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.890389 24145 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.890523 24394 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.890967 23894 catalog_manager.cc:5654] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:32.890389 24471 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.895880 23998 consensus_queue.cc:237] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:32.896814 24471 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20251214 21:03:32.896936 24394 raft_consensus.cc:1275] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20251214 21:03:32.897260 24980 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:32.897473 24958 consensus_queue.cc:1048] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:32.898888 24975 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.899310 24471 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.899461 24394 raft_consensus.cc:2955] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.900453 23881 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d13b1d13a93d4cc3940537b29baf147a with cas_config_opid_index 30: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:32.901154 23896 catalog_manager.cc:5654] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 30 to 31, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New cstate: current_term: 1 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:32.903721 24139 tablet_service.cc:1552] Processing DeleteTablet for tablet d13b1d13a93d4cc3940537b29baf147a with delete_type TABLET_DATA_TOMBSTONED (TS fe19ae24b84b428e8559931c04f1a6b2 not found in new config with opid_index 31) from {username='slave'} at 127.0.0.1:37106
I20251214 21:03:32.904093 24981 tablet_replica.cc:333] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:32.904417 24981 raft_consensus.cc:2243] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:32.904631 24981 raft_consensus.cc:2272] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:32.905210 24981 ts_tablet_manager.cc:1916] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:32.907192 24981 ts_tablet_manager.cc:1929] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.30
I20251214 21:03:32.907263 24981 log.cc:1199] T d13b1d13a93d4cc3940537b29baf147a P fe19ae24b84b428e8559931c04f1a6b2: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/d13b1d13a93d4cc3940537b29baf147a
I20251214 21:03:32.907712 23882 catalog_manager.cc:4985] TS fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947): tablet d13b1d13a93d4cc3940537b29baf147a (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:32.911630 24980 raft_consensus.cc:1064] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: attempting to promote NON_VOTER a52fd6dfbfc440b19b28bcd675e1d210 to VOTER
I20251214 21:03:32.912089 24980 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 27, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:32.913502 24546 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEARNER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:32.913658 24068 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:32.914038 24958 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:32.914232 24980 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:32.914049 24145 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 29. Preceding OpId from leader: term: 2 index: 30. (index mismatch)
I20251214 21:03:32.914634 24980 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:32.916290 24958 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Committing config change with OpId 2.30: config changed from index 29 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.916821 24546 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 29 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.918696 24145 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 29 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.918910 23894 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 29 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:32.919459 24068 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Committing config change with OpId 2.30: config changed from index 29 to 30, a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.922430 23997 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 2.30, Last appended by leader: 27, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:32.923722 24546 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:32.923980 24145 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 2 index: 31. (index mismatch)
I20251214 21:03:32.924225 24980 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:32.924428 24975 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:32.926266 24958 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.926857 24145 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.926857 24546 raft_consensus.cc:2955] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Committing config change with OpId 2.31: config changed from index 30 to 31, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } } }
I20251214 21:03:32.927685 23881 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d9efc0482ebe4a30a7b08b9190e72cdf with cas_config_opid_index 30: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:32.928472 23887 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 reported cstate change: config changed from index 30 to 31, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New cstate: current_term: 2 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:32.930677 24056 tablet_service.cc:1552] Processing DeleteTablet for tablet d9efc0482ebe4a30a7b08b9190e72cdf with delete_type TABLET_DATA_TOMBSTONED (TS 68bf8595326044d78e9d47fe858479d4 not found in new config with opid_index 31) from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:32.930879 24974 tablet_replica.cc:333] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:32.931020 24974 raft_consensus.cc:2243] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:32.931142 24974 raft_consensus.cc:2272] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:32.931716 24974 ts_tablet_manager.cc:1916] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:32.933957 24974 ts_tablet_manager.cc:1929] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.30
I20251214 21:03:32.934039 24974 log.cc:1199] T d9efc0482ebe4a30a7b08b9190e72cdf P 68bf8595326044d78e9d47fe858479d4: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/d9efc0482ebe4a30a7b08b9190e72cdf
I20251214 21:03:32.934476 23883 catalog_manager.cc:4985] TS 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): tablet d9efc0482ebe4a30a7b08b9190e72cdf (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:32.938658 24987 raft_consensus.cc:1064] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: attempting to promote NON_VOTER b4706a6e7f19453ebb19fbfb8ef7558b to VOTER
I20251214 21:03:32.939110 24987 consensus_queue.cc:237] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 2.32, Last appended by leader: 30, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:32.940500 24145 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 2 index: 32. Preceding OpId from leader: term: 2 index: 33. (index mismatch)
I20251214 21:03:32.940491 24471 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 LEARNER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 2 index: 32. Preceding OpId from leader: term: 2 index: 33. (index mismatch)
I20251214 21:03:32.940491 23997 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 2 index: 32. Preceding OpId from leader: term: 2 index: 33. (index mismatch)
I20251214 21:03:32.940867 24987 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:32.941143 24989 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:32.941304 24920 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:32.943117 24990 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 2 LEADER]: Committing config change with OpId 2.33: config changed from index 32 to 33, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.943516 23997 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.33: config changed from index 32 to 33, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.945025 24145 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Committing config change with OpId 2.33: config changed from index 32 to 33, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.946192 23889 catalog_manager.cc:5654] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 reported cstate change: config changed from index 32 to 33, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f0fd707333e94628b613b5d3387fc999" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:32.948081 24471 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Committing config change with OpId 2.33: config changed from index 32 to 33, b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } attrs { replace: true } } peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.951683 24394 consensus_queue.cc:237] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 2.33, Last appended by leader: 30, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } }
I20251214 21:03:32.952852 23997 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 2 index: 33. Preceding OpId from leader: term: 2 index: 34. (index mismatch)
I20251214 21:03:32.953338 24989 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:32.953338 24471 raft_consensus.cc:1275] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Refusing update from remote peer f0fd707333e94628b613b5d3387fc999: Log matching property violated. Preceding OpId in replica: term: 2 index: 33. Preceding OpId from leader: term: 2 index: 34. (index mismatch)
I20251214 21:03:32.954046 24989 consensus_queue.cc:1048] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:32.954802 24990 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 2 LEADER]: Committing config change with OpId 2.34: config changed from index 33 to 34, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.955256 23997 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Committing config change with OpId 2.34: config changed from index 33 to 34, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.955842 24471 raft_consensus.cc:2955] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Committing config change with OpId 2.34: config changed from index 33 to 34, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } }
I20251214 21:03:32.957062 23887 catalog_manager.cc:5654] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 reported cstate change: config changed from index 33 to 34, VOTER fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) evicted. New cstate: current_term: 2 leader_uuid: "f0fd707333e94628b613b5d3387fc999" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:32.957237 23940 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 01da8ce246384c7cb83053adfcffe77a with cas_config_opid_index 33: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:32.959252 24139 tablet_service.cc:1552] Processing DeleteTablet for tablet 01da8ce246384c7cb83053adfcffe77a with delete_type TABLET_DATA_TOMBSTONED (TS fe19ae24b84b428e8559931c04f1a6b2 not found in new config with opid_index 34) from {username='slave'} at 127.0.0.1:37106
I20251214 21:03:32.959636 24981 tablet_replica.cc:333] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:32.959779 24981 raft_consensus.cc:2243] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:32.960028 24981 raft_consensus.cc:2272] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:32.960608 24981 ts_tablet_manager.cc:1916] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:32.962397 24981 ts_tablet_manager.cc:1929] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.33
I20251214 21:03:32.962462 24981 log.cc:1199] T 01da8ce246384c7cb83053adfcffe77a P fe19ae24b84b428e8559931c04f1a6b2: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/01da8ce246384c7cb83053adfcffe77a
I20251214 21:03:32.962920 23882 catalog_manager.cc:4985] TS fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947): tablet 01da8ce246384c7cb83053adfcffe77a (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:33.018594 24471 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251214 21:03:33.019126 24951 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:33.020887 24943 raft_consensus.cc:993] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: : Instructing follower b4706a6e7f19453ebb19fbfb8ef7558b to start an election
I20251214 21:03:33.020992 24951 raft_consensus.cc:1081] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Signalling peer b4706a6e7f19453ebb19fbfb8ef7558b to start an election
I20251214 21:03:33.021492 24469 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd"
dest_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b"
from {username='slave'} at 127.0.0.1:45078
I20251214 21:03:33.021610 24469 raft_consensus.cc:493] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:33.021669 24469 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:33.021793 24395 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 1 LEARNER]: Advancing to term 2
I20251214 21:03:33.022330 24145 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251214 21:03:33.022789 24469 raft_consensus.cc:515] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:33.022831 24395 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 2 LEARNER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 2 index: 32. (index mismatch)
I20251214 21:03:33.022986 24471 raft_consensus.cc:1240] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Rejecting Update request from peer 68bf8595326044d78e9d47fe858479d4 for earlier term 2. Current term is 3. Ops: []
I20251214 21:03:33.023170 24469 leader_election.cc:290] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [CANDIDATE]: Term 3 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947)
I20251214 21:03:33.023231 24995 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:33.023327 24951 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:33.023444 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd" candidate_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" candidate_term: 3 candidate_status { last_received { term: 2 index: 32 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:33.023540 24145 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:33.023604 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ab9fd25bf1604ae4a6c94a9fc07f32cd" candidate_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" candidate_term: 3 candidate_status { last_received { term: 2 index: 32 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:33.023694 24068 raft_consensus.cc:3055] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:33.023730 24068 raft_consensus.cc:740] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:33.023852 24068 consensus_queue.cc:260] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 2.32, Last appended by leader: 32, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:33.023967 24068 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:33.024534 24145 raft_consensus.cc:2468] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4706a6e7f19453ebb19fbfb8ef7558b in term 3.
I20251214 21:03:33.024726 24150 raft_consensus.cc:1240] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Rejecting Update request from peer 68bf8595326044d78e9d47fe858479d4 for earlier term 2. Current term is 3. Ops: [2.32-2.32]
I20251214 21:03:33.024869 24068 raft_consensus.cc:2468] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4706a6e7f19453ebb19fbfb8ef7558b in term 3.
I20251214 21:03:33.025013 24436 leader_election.cc:304] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4706a6e7f19453ebb19fbfb8ef7558b, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:33.025147 24969 raft_consensus.cc:2804] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:33.025219 24969 raft_consensus.cc:697] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Becoming Leader. State: Replica: b4706a6e7f19453ebb19fbfb8ef7558b, State: Running, Role: LEADER
I20251214 21:03:33.025336 24969 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.32, Last appended by leader: 32, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } }
I20251214 21:03:33.026814 23896 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: term changed from 2 to 3, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to b4706a6e7f19453ebb19fbfb8ef7558b (127.20.32.5). New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:33.228197 24068 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 5 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 4 index: 29. Preceding OpId from leader: term: 5 index: 30. (index mismatch)
I20251214 21:03:33.228629 24986 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:33.230865 24546 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 4 index: 29. Preceding OpId from leader: term: 5 index: 30. (index mismatch)
I20251214 21:03:33.231210 24980 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20251214 21:03:33.579955 24395 raft_consensus.cc:3060] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 2 LEARNER]: Advancing to term 3
I20251214 21:03:33.582670 24395 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 2 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:33.583168 24969 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:33.584884 25003 raft_consensus.cc:1064] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
W20251214 21:03:33.584962 25003 raft_consensus.cc:1067] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: Unable to promote non-voter f0fd707333e94628b613b5d3387fc999: Illegal state: Leader has not yet committed an operation in its own term
I20251214 21:03:33.641309 24150 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:33.641726 25003 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:33.644068 24068 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 2 index: 32. Preceding OpId from leader: term: 3 index: 33. (index mismatch)
I20251214 21:03:33.644657 24969 raft_consensus.cc:1064] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: attempting to promote NON_VOTER f0fd707333e94628b613b5d3387fc999 to VOTER
I20251214 21:03:33.644788 25006 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
W20251214 21:03:33.645390 25003 consensus_queue.cc:1175] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fe19ae24b84b428e8559931c04f1a6b2" responder_term: 3 status { last_received { term: 3 index: 33 } last_committed_idx: 33 last_received_current_leader { term: 3 index: 33 } }
I20251214 21:03:33.645619 24969 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 3.33, Last appended by leader: 32, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:33.646787 24150 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 3 index: 34. (index mismatch)
I20251214 21:03:33.647086 25007 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:33.647177 24395 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 3 LEARNER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 3 index: 34. (index mismatch)
I20251214 21:03:33.647785 24068 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 33. Preceding OpId from leader: term: 3 index: 34. (index mismatch)
I20251214 21:03:33.647794 25006 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:33.648190 25006 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:33.649828 24969 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Committing config change with OpId 3.34: config changed from index 31 to 34, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:33.650066 24150 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Committing config change with OpId 3.34: config changed from index 31 to 34, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:33.651320 24068 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Committing config change with OpId 3.34: config changed from index 31 to 34, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:33.651623 24395 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Committing config change with OpId 3.34: config changed from index 31 to 34, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:33.652087 23889 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: config changed from index 31 to 34, f0fd707333e94628b613b5d3387fc999 (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } attrs { replace: true } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:33.656495 24471 consensus_queue.cc:237] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 3.34, Last appended by leader: 32, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } }
I20251214 21:03:33.657536 24395 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 34. Preceding OpId from leader: term: 3 index: 35. (index mismatch)
I20251214 21:03:33.657603 24150 raft_consensus.cc:1275] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Refusing update from remote peer b4706a6e7f19453ebb19fbfb8ef7558b: Log matching property violated. Preceding OpId in replica: term: 3 index: 34. Preceding OpId from leader: term: 3 index: 35. (index mismatch)
I20251214 21:03:33.657881 25003 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:33.658051 25007 consensus_queue.cc:1048] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:33.659533 25007 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Committing config change with OpId 3.35: config changed from index 34 to 35, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:33.659947 24395 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Committing config change with OpId 3.35: config changed from index 34 to 35, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:33.660130 24150 raft_consensus.cc:2955] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Committing config change with OpId 3.35: config changed from index 34 to 35, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } } }
I20251214 21:03:33.661630 23939 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd with cas_config_opid_index 34: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:33.661761 23887 catalog_manager.cc:5654] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b reported cstate change: config changed from index 34 to 35, VOTER 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) evicted. New cstate: current_term: 3 leader_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4706a6e7f19453ebb19fbfb8ef7558b" member_type: VOTER last_known_addr { host: "127.20.32.5" port: 46823 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0fd707333e94628b613b5d3387fc999" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 40145 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:03:33.663903 24056 tablet_service.cc:1552] Processing DeleteTablet for tablet ab9fd25bf1604ae4a6c94a9fc07f32cd with delete_type TABLET_DATA_TOMBSTONED (TS 68bf8595326044d78e9d47fe858479d4 not found in new config with opid_index 35) from {username='slave'} at 127.0.0.1:57942
I20251214 21:03:33.664371 25014 tablet_replica.cc:333] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:33.664498 25014 raft_consensus.cc:2243] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:33.664673 25014 raft_consensus.cc:2272] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:33.665134 25014 ts_tablet_manager.cc:1916] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:33.667058 25014 ts_tablet_manager.cc:1929] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.34
I20251214 21:03:33.667131 25014 log.cc:1199] T ab9fd25bf1604ae4a6c94a9fc07f32cd P 68bf8595326044d78e9d47fe858479d4: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/ab9fd25bf1604ae4a6c94a9fc07f32cd
I20251214 21:03:33.667577 23883 catalog_manager.cc:4985] TS 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): tablet ab9fd25bf1604ae4a6c94a9fc07f32cd (table test-workload [id=640eecf2e5e64ca9ae785e051c1e5ea2]) successfully deleted
I20251214 21:03:34.323390 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:34.325147 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:34.325280 23997 raft_consensus.cc:606] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 5 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:34.325680 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:34.325855 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:34.405025 24980 raft_consensus.cc:993] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:34.405134 24980 raft_consensus.cc:1081] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 5 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:34.405514 24068 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57968
I20251214 21:03:34.405625 24068 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:34.405680 24068 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 5 FOLLOWER]: Advancing to term 6
I20251214 21:03:34.406544 24068 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:34.406936 24068 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 6 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:34.407236 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 30 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:34.407333 24546 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Advancing to term 6
I20251214 21:03:34.407240 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 30 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:34.407433 23997 raft_consensus.cc:3055] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 5 LEADER]: Stepping down as leader of term 5
I20251214 21:03:34.407477 23997 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:34.407614 23997 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 5.30, Last appended by leader: 30, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:34.407768 23997 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Advancing to term 6
I20251214 21:03:34.408146 24546 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 6.
I20251214 21:03:34.408429 24041 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:34.408517 23997 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 6.
I20251214 21:03:34.408609 24995 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 6 FOLLOWER]: Leader election won for term 6
I20251214 21:03:34.408769 24995 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 6 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:34.408905 24995 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 5.30, Last appended by leader: 30, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:34.410267 23896 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 5 to 6, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 6 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:34.788866 24546 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 6 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 30. Preceding OpId from leader: term: 6 index: 31. (index mismatch)
I20251214 21:03:34.789376 24995 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:34.792284 23997 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 6 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 30. Preceding OpId from leader: term: 6 index: 31. (index mismatch)
I20251214 21:03:34.792667 25016 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20251214 21:03:36.326233 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:36.328063 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:36.328207 24068 raft_consensus.cc:606] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 6 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:36.328635 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:36.328760 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:36.739895 25028 raft_consensus.cc:993] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:36.740006 25028 raft_consensus.cc:1081] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 6 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:36.740495 23997 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50500
I20251214 21:03:36.740631 23997 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:36.740696 23997 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 6 FOLLOWER]: Advancing to term 7
I20251214 21:03:36.741736 23997 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:36.742183 23997 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 7 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:36.742552 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 7 candidate_status { last_received { term: 6 index: 31 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:36.742558 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 7 candidate_status { last_received { term: 6 index: 31 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:36.742666 24068 raft_consensus.cc:3055] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 6 LEADER]: Stepping down as leader of term 6
I20251214 21:03:36.742681 24546 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 6 FOLLOWER]: Advancing to term 7
I20251214 21:03:36.742729 24068 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:36.742983 24068 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 6.31, Last appended by leader: 31, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:36.743196 24068 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 6 FOLLOWER]: Advancing to term 7
I20251214 21:03:36.743496 24546 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 7.
I20251214 21:03:36.743775 23965 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:36.743958 24980 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 7 FOLLOWER]: Leader election won for term 7
I20251214 21:03:36.744102 24980 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 7 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:36.744199 24068 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 7.
I20251214 21:03:36.744398 24980 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 6.31, Last appended by leader: 31, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:36.745898 23896 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 6 to 7, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 7 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:37.146170 24546 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 7 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 6 index: 31. Preceding OpId from leader: term: 7 index: 32. (index mismatch)
I20251214 21:03:37.146571 24980 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:37.148881 24068 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 7 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 6 index: 31. Preceding OpId from leader: term: 7 index: 32. (index mismatch)
I20251214 21:03:37.149551 25030 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:38.329135 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:38.330816 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:38.330966 23997 raft_consensus.cc:606] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Received request to transfer leadership to TS fe19ae24b84b428e8559931c04f1a6b2
I20251214 21:03:38.331275 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:38.331387 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:38.645946 25030 raft_consensus.cc:993] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: : Instructing follower fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:38.646054 25030 raft_consensus.cc:1081] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Signalling peer fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:38.646486 24150 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:37122
I20251214 21:03:38.646608 24150 raft_consensus.cc:493] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:38.646667 24150 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:38.648655 24150 raft_consensus.cc:515] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:38.649035 24150 leader_election.cc:290] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 3 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:38.649312 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 31 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:38.649328 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 31 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:38.649449 24546 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:38.649449 23997 raft_consensus.cc:3055] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:03:38.649537 23997 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:38.649675 23997 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 31, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:38.649874 23997 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:03:38.650506 24546 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 3.
I20251214 21:03:38.650694 23997 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 3.
I20251214 21:03:38.650838 24116 leader_election.cc:304] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a52fd6dfbfc440b19b28bcd675e1d210, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:38.651002 24963 raft_consensus.cc:2804] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:03:38.651173 24963 raft_consensus.cc:697] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:38.651304 24963 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 2.31, Last appended by leader: 31, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:38.652637 23896 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 2 to 3, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 3 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:39.052027 23997 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251214 21:03:39.052423 24963 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:39.054678 24546 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 31. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
I20251214 21:03:39.055038 24963 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20251214 21:03:40.331713 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:40.333531 24150 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:37144
I20251214 21:03:40.333674 24150 raft_consensus.cc:606] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:40.334096 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:40.334208 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:40.642151 25056 raft_consensus.cc:993] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:40.642271 25056 raft_consensus.cc:1081] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:40.642678 23997 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50490
I20251214 21:03:40.642824 23997 raft_consensus.cc:493] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:40.642889 23997 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:40.643728 23997 raft_consensus.cc:515] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:40.644079 23997 leader_election.cc:290] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 4 election: Requested vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:40.644381 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 4 candidate_status { last_received { term: 3 index: 32 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:40.644399 24150 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 4 candidate_status { last_received { term: 3 index: 32 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:40.644500 24546 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:40.644533 24150 raft_consensus.cc:3055] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Stepping down as leader of term 3
I20251214 21:03:40.644582 24150 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:40.644717 24150 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 3.32, Last appended by leader: 32, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:40.644860 24150 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:03:40.645325 24546 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 4.
I20251214 21:03:40.645617 23965 leader_election.cc:304] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:40.645637 24150 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 4.
I20251214 21:03:40.645818 25030 raft_consensus.cc:2804] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Leader election won for term 4
I20251214 21:03:40.645985 25030 raft_consensus.cc:697] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:40.646131 25030 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 3.32, Last appended by leader: 32, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:40.654066 23896 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 3 to 4, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 4 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:41.076117 24150 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 4 index: 33. (index mismatch)
I20251214 21:03:41.076499 25030 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:41.078941 24546 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 3 index: 32. Preceding OpId from leader: term: 4 index: 33. (index mismatch)
I20251214 21:03:41.079579 25030 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:42.334527 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:42.336416 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:42.336624 23997 raft_consensus.cc:606] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 7 LEADER]: Received request to transfer leadership to TS 68bf8595326044d78e9d47fe858479d4
I20251214 21:03:42.337006 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:42.337136 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:42.729580 25070 raft_consensus.cc:993] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: : Instructing follower 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:42.729729 25070 raft_consensus.cc:1081] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 7 LEADER]: Signalling peer 68bf8595326044d78e9d47fe858479d4 to start an election
I20251214 21:03:42.730171 24068 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
from {username='slave'} at 127.0.0.1:57968
I20251214 21:03:42.730296 24068 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:42.730340 24068 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 7 FOLLOWER]: Advancing to term 8
I20251214 21:03:42.731177 24068 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:42.731565 24068 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 8 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:42.731876 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 32 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:42.731909 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "68bf8595326044d78e9d47fe858479d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 32 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:42.731971 24546 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 7 FOLLOWER]: Advancing to term 8
I20251214 21:03:42.732005 23997 raft_consensus.cc:3055] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 7 LEADER]: Stepping down as leader of term 7
I20251214 21:03:42.732055 23997 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:42.732197 23997 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 7.32, Last appended by leader: 32, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:42.732385 23997 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 7 FOLLOWER]: Advancing to term 8
I20251214 21:03:42.732828 24546 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 8.
I20251214 21:03:42.733093 24041 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68bf8595326044d78e9d47fe858479d4, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:42.733227 23997 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68bf8595326044d78e9d47fe858479d4 in term 8.
I20251214 21:03:42.733248 25028 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 8 FOLLOWER]: Leader election won for term 8
I20251214 21:03:42.733420 25028 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 8 LEADER]: Becoming Leader. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:42.733587 25028 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 7.32, Last appended by leader: 32, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:42.734987 23894 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 reported cstate change: term changed from 7 to 8, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to 68bf8595326044d78e9d47fe858479d4 (127.20.32.2). New cstate: current_term: 8 leader_uuid: "68bf8595326044d78e9d47fe858479d4" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:43.247920 24546 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 8 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 32. Preceding OpId from leader: term: 8 index: 33. (index mismatch)
I20251214 21:03:43.248276 25028 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:43.251603 23997 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 8 FOLLOWER]: Refusing update from remote peer 68bf8595326044d78e9d47fe858479d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 32. Preceding OpId from leader: term: 8 index: 33. (index mismatch)
I20251214 21:03:43.251971 25079 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20251214 21:03:44.337496 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:44.339396 24068 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "68bf8595326044d78e9d47fe858479d4"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:40988
I20251214 21:03:44.339565 24068 raft_consensus.cc:606] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 8 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:44.339998 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:44.340101 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:44.347620 25085 raft_consensus.cc:993] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:44.347766 25079 raft_consensus.cc:1081] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 8 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:44.348202 23997 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50500
I20251214 21:03:44.348321 23997 raft_consensus.cc:493] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:44.348465 23997 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 8 FOLLOWER]: Advancing to term 9
I20251214 21:03:44.349342 23997 raft_consensus.cc:515] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:44.349653 23997 leader_election.cc:290] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 9 election: Requested vote from peers 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:44.350005 24068 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 9 candidate_status { last_received { term: 8 index: 33 } } ignore_live_leader: true dest_uuid: "68bf8595326044d78e9d47fe858479d4"
I20251214 21:03:44.350016 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3628382de7514932a1ea8072fb2eaeb8" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 9 candidate_status { last_received { term: 8 index: 33 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:44.350126 24546 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 8 FOLLOWER]: Advancing to term 9
I20251214 21:03:44.350134 24068 raft_consensus.cc:3055] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 8 LEADER]: Stepping down as leader of term 8
I20251214 21:03:44.350200 24068 raft_consensus.cc:740] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 68bf8595326044d78e9d47fe858479d4, State: Running, Role: LEADER
I20251214 21:03:44.350340 24068 consensus_queue.cc:260] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 8.33, Last appended by leader: 33, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:44.350481 24068 raft_consensus.cc:3060] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 8 FOLLOWER]: Advancing to term 9
I20251214 21:03:44.350942 24546 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 9.
I20251214 21:03:44.351231 23965 leader_election.cc:304] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:44.351310 24068 raft_consensus.cc:2468] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 9.
I20251214 21:03:44.351388 25070 raft_consensus.cc:2804] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 9 FOLLOWER]: Leader election won for term 9
I20251214 21:03:44.351536 25070 raft_consensus.cc:697] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 9 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:44.351663 25070 consensus_queue.cc:237] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 8.33, Last appended by leader: 33, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:44.353034 23894 catalog_manager.cc:5654] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 8 to 9, leader changed from 68bf8595326044d78e9d47fe858479d4 (127.20.32.2) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 9 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:44.786557 24068 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 9 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 8 index: 33. Preceding OpId from leader: term: 9 index: 34. (index mismatch)
I20251214 21:03:44.786988 25070 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68bf8595326044d78e9d47fe858479d4" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:44.789866 24546 raft_consensus.cc:1275] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 9 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 8 index: 33. Preceding OpId from leader: term: 9 index: 34. (index mismatch)
I20251214 21:03:44.790225 25094 consensus_queue.cc:1048] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:46.340382 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:46.342046 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:46.342195 23997 raft_consensus.cc:606] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Received request to transfer leadership to TS fe19ae24b84b428e8559931c04f1a6b2
I20251214 21:03:46.342537 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:46.342641 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:46.651345 25094 raft_consensus.cc:993] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: : Instructing follower fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:46.651463 25094 raft_consensus.cc:1081] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Signalling peer fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:46.651891 24145 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:37122
I20251214 21:03:46.652021 24145 raft_consensus.cc:493] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:46.652081 24145 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:46.653100 24145 raft_consensus.cc:515] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:46.653506 24145 leader_election.cc:290] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 5 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:46.653863 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 33 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:46.653882 23997 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 33 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:46.653996 24546 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:46.654014 23997 raft_consensus.cc:3055] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Stepping down as leader of term 4
I20251214 21:03:46.654050 23997 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:46.654199 23997 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 4.33, Last appended by leader: 33, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:46.654356 23997 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Advancing to term 5
I20251214 21:03:46.655030 24546 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 5.
I20251214 21:03:46.655166 23997 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 5.
I20251214 21:03:46.655349 24116 leader_election.cc:304] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a52fd6dfbfc440b19b28bcd675e1d210, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:46.655594 25056 raft_consensus.cc:2804] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 5 FOLLOWER]: Leader election won for term 5
I20251214 21:03:46.655773 25056 raft_consensus.cc:697] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:46.655941 25056 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 4.33, Last appended by leader: 33, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:46.657588 23896 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 4 to 5, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 5 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:47.051040 24546 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 33. Preceding OpId from leader: term: 5 index: 34. (index mismatch)
I20251214 21:03:47.051723 25100 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:47.054512 23997 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 33. Preceding OpId from leader: term: 5 index: 34. (index mismatch)
I20251214 21:03:47.055370 25100 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20251214 21:03:48.342973 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:48.344849 24145 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
mode: GRACEFUL
new_leader_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:37144
I20251214 21:03:48.344978 24145 raft_consensus.cc:606] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Received request to transfer leadership to TS 126ee409f2314ba091e87159b26c0c62
I20251214 21:03:48.345293 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:48.345398 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:48.413806 25111 raft_consensus.cc:993] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2: : Instructing follower 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:48.413921 25111 raft_consensus.cc:1081] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Signalling peer 126ee409f2314ba091e87159b26c0c62 to start an election
I20251214 21:03:48.414283 23997 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
from {username='slave'} at 127.0.0.1:50490
I20251214 21:03:48.414397 23997 raft_consensus.cc:493] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:48.414443 23997 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 5 FOLLOWER]: Advancing to term 6
I20251214 21:03:48.415222 23997 raft_consensus.cc:515] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:48.415627 23997 leader_election.cc:290] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 6 election: Requested vote from peers fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3:32947), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:48.415936 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 6 candidate_status { last_received { term: 5 index: 34 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:48.416030 24546 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Advancing to term 6
I20251214 21:03:48.415943 24145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "126ee409f2314ba091e87159b26c0c62" candidate_term: 6 candidate_status { last_received { term: 5 index: 34 } } ignore_live_leader: true dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
I20251214 21:03:48.416111 24145 raft_consensus.cc:3055] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Stepping down as leader of term 5
I20251214 21:03:48.416153 24145 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:48.416285 24145 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 5.34, Last appended by leader: 34, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:48.416437 24145 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 5 FOLLOWER]: Advancing to term 6
I20251214 21:03:48.417050 24546 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 6.
I20251214 21:03:48.417321 23965 leader_election.cc:304] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 126ee409f2314ba091e87159b26c0c62, a52fd6dfbfc440b19b28bcd675e1d210; no voters:
I20251214 21:03:48.417414 24145 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 126ee409f2314ba091e87159b26c0c62 in term 6.
I20251214 21:03:48.417464 25094 raft_consensus.cc:2804] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 6 FOLLOWER]: Leader election won for term 6
I20251214 21:03:48.417593 25094 raft_consensus.cc:697] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 6 LEADER]: Becoming Leader. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:48.417744 25094 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 5.34, Last appended by leader: 34, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:48.419170 23894 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 reported cstate change: term changed from 5 to 6, leader changed from fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3) to 126ee409f2314ba091e87159b26c0c62 (127.20.32.1). New cstate: current_term: 6 leader_uuid: "126ee409f2314ba091e87159b26c0c62" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:48.898929 24546 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 6 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 5 index: 34. Preceding OpId from leader: term: 6 index: 35. (index mismatch)
I20251214 21:03:48.899348 25094 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:48.902693 24145 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 6 FOLLOWER]: Refusing update from remote peer 126ee409f2314ba091e87159b26c0c62: Log matching property violated. Preceding OpId in replica: term: 5 index: 34. Preceding OpId from leader: term: 6 index: 35. (index mismatch)
I20251214 21:03:48.903162 25094 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20251214 21:03:50.345749 23950 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:50.347466 23997 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "126ee409f2314ba091e87159b26c0c62"
mode: GRACEFUL
new_leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:50518
I20251214 21:03:50.347621 23997 raft_consensus.cc:606] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 6 LEADER]: Received request to transfer leadership to TS fe19ae24b84b428e8559931c04f1a6b2
I20251214 21:03:50.347990 23950 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:50.348125 23950 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:50.517118 25113 raft_consensus.cc:993] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: : Instructing follower fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:50.517246 25113 raft_consensus.cc:1081] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 6 LEADER]: Signalling peer fe19ae24b84b428e8559931c04f1a6b2 to start an election
I20251214 21:03:50.517660 24145 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf"
dest_uuid: "fe19ae24b84b428e8559931c04f1a6b2"
from {username='slave'} at 127.0.0.1:37122
I20251214 21:03:50.517802 24145 raft_consensus.cc:493] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:50.517849 24145 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 6 FOLLOWER]: Advancing to term 7
I20251214 21:03:50.518772 24145 raft_consensus.cc:515] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:50.519199 24145 leader_election.cc:290] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 7 election: Requested vote from peers 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681), a52fd6dfbfc440b19b28bcd675e1d210 (127.20.32.6:36351)
I20251214 21:03:50.519474 23998 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: true dest_uuid: "126ee409f2314ba091e87159b26c0c62"
I20251214 21:03:50.519589 23998 raft_consensus.cc:3055] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 6 LEADER]: Stepping down as leader of term 6
I20251214 21:03:50.519515 24546 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9efc0482ebe4a30a7b08b9190e72cdf" candidate_uuid: "fe19ae24b84b428e8559931c04f1a6b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: true dest_uuid: "a52fd6dfbfc440b19b28bcd675e1d210"
I20251214 21:03:50.519637 23998 raft_consensus.cc:740] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 126ee409f2314ba091e87159b26c0c62, State: Running, Role: LEADER
I20251214 21:03:50.519692 24546 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 6 FOLLOWER]: Advancing to term 7
I20251214 21:03:50.519781 23998 consensus_queue.cc:260] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 6.35, Last appended by leader: 35, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:50.519973 23998 raft_consensus.cc:3060] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 6 FOLLOWER]: Advancing to term 7
I20251214 21:03:50.520555 24546 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 7.
I20251214 21:03:50.520721 23998 raft_consensus.cc:2468] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe19ae24b84b428e8559931c04f1a6b2 in term 7.
I20251214 21:03:50.520838 24116 leader_election.cc:304] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a52fd6dfbfc440b19b28bcd675e1d210, fe19ae24b84b428e8559931c04f1a6b2; no voters:
I20251214 21:03:50.521010 25111 raft_consensus.cc:2804] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 7 FOLLOWER]: Leader election won for term 7
I20251214 21:03:50.521142 25111 raft_consensus.cc:697] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 7 LEADER]: Becoming Leader. State: Replica: fe19ae24b84b428e8559931c04f1a6b2, State: Running, Role: LEADER
I20251214 21:03:50.521260 25111 consensus_queue.cc:237] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 6.35, Last appended by leader: 35, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } }
I20251214 21:03:50.522641 23896 catalog_manager.cc:5654] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 reported cstate change: term changed from 6 to 7, leader changed from 126ee409f2314ba091e87159b26c0c62 (127.20.32.1) to fe19ae24b84b428e8559931c04f1a6b2 (127.20.32.3). New cstate: current_term: 7 leader_uuid: "fe19ae24b84b428e8559931c04f1a6b2" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe19ae24b84b428e8559931c04f1a6b2" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 32947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:50.970852 24546 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 7 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 35. Preceding OpId from leader: term: 7 index: 36. (index mismatch)
I20251214 21:03:50.971328 25111 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a52fd6dfbfc440b19b28bcd675e1d210" member_type: VOTER last_known_addr { host: "127.20.32.6" port: 36351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20251214 21:03:50.973901 23998 raft_consensus.cc:1275] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 7 FOLLOWER]: Refusing update from remote peer fe19ae24b84b428e8559931c04f1a6b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 35. Preceding OpId from leader: term: 7 index: 36. (index mismatch)
I20251214 21:03:50.974274 25111 consensus_queue.cc:1048] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "126ee409f2314ba091e87159b26c0c62" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/auto_rebalancer-test.cc:196: Failure
Expected equality of these values:
0
NumMovesScheduled(leader_idx, BalanceThreadType::LEADER_REBALANCE)
Which is: 1
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:403: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/auto_rebalancer-test.cc:575: Failure
Expected: CheckNoLeaderMovesScheduled() doesn't generate new fatal failures in the current thread.
Actual: it does.
I20251214 21:03:51.687566 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
W20251214 21:03:51.689179 24510 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20251214 21:03:51.690352 24510 consensus_peers.cc:597] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 -> Peer 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681): Couldn't send request to peer 126ee409f2314ba091e87159b26c0c62. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:51.693135 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:51.693383 20608 tablet_replica.cc:333] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:51.693498 20608 raft_consensus.cc:2243] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.693624 20608 raft_consensus.cc:2272] T 445f6b3b3b63458abdaa3054956e957b P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.694110 20608 tablet_replica.cc:333] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:51.694201 20608 raft_consensus.cc:2243] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.694305 20608 raft_consensus.cc:2272] T 14f65411fb9c45b0892ef02beae5b884 P 126ee409f2314ba091e87159b26c0c62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.694628 20608 tablet_replica.cc:333] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:51.694705 20608 raft_consensus.cc:2243] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 7 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.694792 20608 raft_consensus.cc:2272] T d9efc0482ebe4a30a7b08b9190e72cdf P 126ee409f2314ba091e87159b26c0c62 [term 7 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.695237 20608 tablet_replica.cc:333] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:51.695325 20608 raft_consensus.cc:2243] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.695492 20608 raft_consensus.cc:2272] T d13b1d13a93d4cc3940537b29baf147a P 126ee409f2314ba091e87159b26c0c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.695797 20608 tablet_replica.cc:333] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:51.695876 20608 raft_consensus.cc:2243] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.695984 20608 raft_consensus.cc:2272] T 01da8ce246384c7cb83053adfcffe77a P 126ee409f2314ba091e87159b26c0c62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.696287 20608 tablet_replica.cc:333] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:51.696369 20608 raft_consensus.cc:2243] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.696455 20608 raft_consensus.cc:2272] T 0d4b592c0409483384330ac5cfcbe8b5 P 126ee409f2314ba091e87159b26c0c62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.696750 20608 tablet_replica.cc:333] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62: stopping tablet replica
I20251214 21:03:51.696820 20608 raft_consensus.cc:2243] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 9 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.696974 20608 raft_consensus.cc:2272] T 3628382de7514932a1ea8072fb2eaeb8 P 126ee409f2314ba091e87159b26c0c62 [term 9 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.712692 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:03:51.715781 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:03:51.720077 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:51.720319 20608 tablet_replica.cc:333] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:51.720443 20608 raft_consensus.cc:2243] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.720551 20608 raft_consensus.cc:2272] T d246d019db6f483dab560d45620c2aec P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.720966 20608 tablet_replica.cc:333] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:51.721052 20608 raft_consensus.cc:2243] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.721125 20608 raft_consensus.cc:2272] T 14f65411fb9c45b0892ef02beae5b884 P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.721403 20608 tablet_replica.cc:333] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:51.721477 20608 raft_consensus.cc:2243] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 3 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.721619 20608 raft_consensus.cc:2272] T 0d4b592c0409483384330ac5cfcbe8b5 P 68bf8595326044d78e9d47fe858479d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.721969 20608 tablet_replica.cc:333] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:51.722050 20608 raft_consensus.cc:2243] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.722163 20608 raft_consensus.cc:2272] T 445f6b3b3b63458abdaa3054956e957b P 68bf8595326044d78e9d47fe858479d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.722441 20608 tablet_replica.cc:333] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:51.722508 20608 raft_consensus.cc:2243] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 4 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.722649 20608 raft_consensus.cc:2272] T f498cd6fedac4052b7593b1dda35af6a P 68bf8595326044d78e9d47fe858479d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.722924 20608 tablet_replica.cc:333] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4: stopping tablet replica
I20251214 21:03:51.722987 20608 raft_consensus.cc:2243] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.723057 20608 raft_consensus.cc:2272] T 3628382de7514932a1ea8072fb2eaeb8 P 68bf8595326044d78e9d47fe858479d4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.738341 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:03:51.741665 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:03:51.746767 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:51.747313 20608 tablet_replica.cc:333] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:51.747457 20608 raft_consensus.cc:2243] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.747601 20608 raft_consensus.cc:2272] T ab9fd25bf1604ae4a6c94a9fc07f32cd P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.748024 20608 tablet_replica.cc:333] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:51.748116 20608 raft_consensus.cc:2243] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.748235 20608 raft_consensus.cc:2272] T 0d4b592c0409483384330ac5cfcbe8b5 P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20251214 21:03:51.748373 24116 consensus_peers.cc:597] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 -> Peer 68bf8595326044d78e9d47fe858479d4 (127.20.32.2:36087): Couldn't send request to peer 68bf8595326044d78e9d47fe858479d4. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.2:36087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:51.748574 20608 tablet_replica.cc:333] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:51.748754 20608 raft_consensus.cc:2243] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.748883 20608 raft_consensus.cc:2272] T f498cd6fedac4052b7593b1dda35af6a P fe19ae24b84b428e8559931c04f1a6b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.749228 20608 tablet_replica.cc:333] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:51.749313 20608 raft_consensus.cc:2243] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 7 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.749481 20608 raft_consensus.cc:2272] T d9efc0482ebe4a30a7b08b9190e72cdf P fe19ae24b84b428e8559931c04f1a6b2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.749945 20608 tablet_replica.cc:333] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:51.750030 20608 raft_consensus.cc:2243] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 5 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.750169 20608 raft_consensus.cc:2272] T f19d4d6bfd10472094bb7a6f81cd06b4 P fe19ae24b84b428e8559931c04f1a6b2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.750486 20608 tablet_replica.cc:333] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2: stopping tablet replica
I20251214 21:03:51.750569 20608 raft_consensus.cc:2243] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 3 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.750710 20608 raft_consensus.cc:2272] T d246d019db6f483dab560d45620c2aec P fe19ae24b84b428e8559931c04f1a6b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.766450 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:03:51.769889 20608 tablet_server.cc:178] TabletServer@127.20.32.4:0 shutting down...
I20251214 21:03:51.774118 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:51.774323 20608 tablet_replica.cc:333] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999: stopping tablet replica
I20251214 21:03:51.774461 20608 raft_consensus.cc:2243] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.774618 20608 raft_consensus.cc:2272] T ab9fd25bf1604ae4a6c94a9fc07f32cd P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.775336 20608 tablet_replica.cc:333] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999: stopping tablet replica
I20251214 21:03:51.775466 20608 raft_consensus.cc:2243] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.775594 20608 raft_consensus.cc:2272] T 4c649579f0f94f23aca3eafa7d81df2e P f0fd707333e94628b613b5d3387fc999 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.775956 20608 tablet_replica.cc:333] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999: stopping tablet replica
I20251214 21:03:51.776060 20608 raft_consensus.cc:2243] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.776157 20608 raft_consensus.cc:2272] T f498cd6fedac4052b7593b1dda35af6a P f0fd707333e94628b613b5d3387fc999 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.776526 20608 tablet_replica.cc:333] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999: stopping tablet replica
I20251214 21:03:51.776612 20608 raft_consensus.cc:2243] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.776731 20608 raft_consensus.cc:2272] T d13b1d13a93d4cc3940537b29baf147a P f0fd707333e94628b613b5d3387fc999 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.777040 20608 tablet_replica.cc:333] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999: stopping tablet replica
I20251214 21:03:51.777119 20608 raft_consensus.cc:2243] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.777246 20608 raft_consensus.cc:2272] T f19d4d6bfd10472094bb7a6f81cd06b4 P f0fd707333e94628b613b5d3387fc999 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.777546 20608 tablet_replica.cc:333] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999: stopping tablet replica
I20251214 21:03:51.777622 20608 raft_consensus.cc:2243] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.777829 20608 raft_consensus.cc:2272] T 01da8ce246384c7cb83053adfcffe77a P f0fd707333e94628b613b5d3387fc999 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251214 21:03:51.786521 24510 consensus_peers.cc:597] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 -> Peer 126ee409f2314ba091e87159b26c0c62 (127.20.32.1:39681): Couldn't send request to peer 126ee409f2314ba091e87159b26c0c62. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:39681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:51.791041 20608 tablet_server.cc:195] TabletServer@127.20.32.4:0 shutdown complete.
I20251214 21:03:51.793989 20608 tablet_server.cc:178] TabletServer@127.20.32.5:0 shutting down...
I20251214 21:03:51.798120 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:51.798339 20608 tablet_replica.cc:333] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b: stopping tablet replica
I20251214 21:03:51.798470 20608 raft_consensus.cc:2243] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.798610 20608 raft_consensus.cc:2272] T 01da8ce246384c7cb83053adfcffe77a P b4706a6e7f19453ebb19fbfb8ef7558b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.799057 20608 tablet_replica.cc:333] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b: stopping tablet replica
I20251214 21:03:51.799152 20608 raft_consensus.cc:2243] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.799263 20608 raft_consensus.cc:2272] T d13b1d13a93d4cc3940537b29baf147a P b4706a6e7f19453ebb19fbfb8ef7558b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.799590 20608 tablet_replica.cc:333] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b: stopping tablet replica
I20251214 21:03:51.799678 20608 raft_consensus.cc:2243] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.799841 20608 raft_consensus.cc:2272] T ab9fd25bf1604ae4a6c94a9fc07f32cd P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.800140 20608 tablet_replica.cc:333] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b: stopping tablet replica
I20251214 21:03:51.800235 20608 raft_consensus.cc:2243] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.800336 20608 raft_consensus.cc:2272] T d246d019db6f483dab560d45620c2aec P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.800627 20608 tablet_replica.cc:333] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b: stopping tablet replica
I20251214 21:03:51.800711 20608 raft_consensus.cc:2243] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 4 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.800824 20608 raft_consensus.cc:2272] T f498cd6fedac4052b7593b1dda35af6a P b4706a6e7f19453ebb19fbfb8ef7558b [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.801110 20608 tablet_replica.cc:333] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b: stopping tablet replica
I20251214 21:03:51.801187 20608 raft_consensus.cc:2243] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.801347 20608 raft_consensus.cc:2272] T 4c649579f0f94f23aca3eafa7d81df2e P b4706a6e7f19453ebb19fbfb8ef7558b [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.816190 20608 tablet_server.cc:195] TabletServer@127.20.32.5:0 shutdown complete.
I20251214 21:03:51.818872 20608 tablet_server.cc:178] TabletServer@127.20.32.6:0 shutting down...
I20251214 21:03:51.822918 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:03:51.823253 20608 tablet_replica.cc:333] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210: stopping tablet replica
I20251214 21:03:51.823400 20608 raft_consensus.cc:2243] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.823554 20608 raft_consensus.cc:2272] T f19d4d6bfd10472094bb7a6f81cd06b4 P a52fd6dfbfc440b19b28bcd675e1d210 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.824043 20608 tablet_replica.cc:333] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210: stopping tablet replica
I20251214 21:03:51.824141 20608 raft_consensus.cc:2243] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 9 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.824254 20608 raft_consensus.cc:2272] T 3628382de7514932a1ea8072fb2eaeb8 P a52fd6dfbfc440b19b28bcd675e1d210 [term 9 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.824568 20608 tablet_replica.cc:333] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210: stopping tablet replica
I20251214 21:03:51.824656 20608 raft_consensus.cc:2243] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.824775 20608 raft_consensus.cc:2272] T 4c649579f0f94f23aca3eafa7d81df2e P a52fd6dfbfc440b19b28bcd675e1d210 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.825083 20608 tablet_replica.cc:333] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210: stopping tablet replica
I20251214 21:03:51.825162 20608 raft_consensus.cc:2243] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 7 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:51.825266 20608 raft_consensus.cc:2272] T d9efc0482ebe4a30a7b08b9190e72cdf P a52fd6dfbfc440b19b28bcd675e1d210 [term 7 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.825769 20608 tablet_replica.cc:333] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210: stopping tablet replica
I20251214 21:03:51.825858 20608 raft_consensus.cc:2243] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.826040 20608 raft_consensus.cc:2272] T 14f65411fb9c45b0892ef02beae5b884 P a52fd6dfbfc440b19b28bcd675e1d210 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.826337 20608 tablet_replica.cc:333] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210: stopping tablet replica
I20251214 21:03:51.826411 20608 raft_consensus.cc:2243] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.826543 20608 raft_consensus.cc:2272] T 445f6b3b3b63458abdaa3054956e957b P a52fd6dfbfc440b19b28bcd675e1d210 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.839733 20608 tablet_server.cc:195] TabletServer@127.20.32.6:0 shutdown complete.
I20251214 21:03:51.842562 20608 master.cc:561] Master@127.20.32.62:36169 shutting down...
I20251214 21:03:51.846357 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:03:51.846529 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:51.846588 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P cccb6adcb4834ef9ab61c50fa532f0ab: stopping tablet replica
I20251214 21:03:51.859902 20608 master.cc:583] Master@127.20.32.62:36169 shutdown complete.
I20251214 21:03:51.863528 20608 test_util.cc:183] -----------------------------------------------
I20251214 21:03:51.863592 20608 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestMaxMovesPerServer.1765746102914115-20608-0
[ FAILED ] AutoRebalancerTest.TestMaxMovesPerServer (35724 ms)
[ RUN ] AutoRebalancerTest.AutoRebalancingUnstableCluster
I20251214 21:03:51.864243 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:46679
I20251214 21:03:51.864558 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:51.866261 25142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:51.866333 25145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:51.866397 25143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:51.866554 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:51.866685 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:51.866719 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:51.866734 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746231866733 us; error 0 us; skew 500 ppm
I20251214 21:03:51.867427 20608 webserver.cc:492] Webserver started at http://127.20.32.62:43487/ using document root <none> and password file <none>
I20251214 21:03:51.867542 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:51.867576 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:51.867626 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:51.867936 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "c25810183da0499480a6725af1a2c7a1"
format_stamp: "Formatted at 2025-12-14 21:03:51 on dist-test-slave-bphs"
I20251214 21:03:51.869222 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:51.870059 25150 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:51.870270 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:51.870326 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "c25810183da0499480a6725af1a2c7a1"
format_stamp: "Formatted at 2025-12-14 21:03:51 on dist-test-slave-bphs"
I20251214 21:03:51.870376 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:51.884559 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:51.884902 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:51.888646 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:46679
I20251214 21:03:51.895696 25202 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:46679 every 8 connection(s)
I20251214 21:03:51.896167 25203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:51.898056 25203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1: Bootstrap starting.
I20251214 21:03:51.898808 25203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:51.899760 25203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1: No bootstrap required, opened a new log
I20251214 21:03:51.900118 25203 raft_consensus.cc:359] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25810183da0499480a6725af1a2c7a1" member_type: VOTER }
I20251214 21:03:51.900202 25203 raft_consensus.cc:385] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:51.900231 25203 raft_consensus.cc:740] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25810183da0499480a6725af1a2c7a1, State: Initialized, Role: FOLLOWER
I20251214 21:03:51.900364 25203 consensus_queue.cc:260] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25810183da0499480a6725af1a2c7a1" member_type: VOTER }
I20251214 21:03:51.900429 25203 raft_consensus.cc:399] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:03:51.900467 25203 raft_consensus.cc:493] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:03:51.900513 25203 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:51.901163 25203 raft_consensus.cc:515] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25810183da0499480a6725af1a2c7a1" member_type: VOTER }
I20251214 21:03:51.901278 25203 leader_election.cc:304] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c25810183da0499480a6725af1a2c7a1; no voters:
I20251214 21:03:51.901440 25203 leader_election.cc:290] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:03:51.901572 25206 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:51.901799 25206 raft_consensus.cc:697] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 1 LEADER]: Becoming Leader. State: Replica: c25810183da0499480a6725af1a2c7a1, State: Running, Role: LEADER
I20251214 21:03:51.901854 25203 sys_catalog.cc:565] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:03:51.901917 25206 consensus_queue.cc:237] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25810183da0499480a6725af1a2c7a1" member_type: VOTER }
I20251214 21:03:51.902312 25207 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c25810183da0499480a6725af1a2c7a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25810183da0499480a6725af1a2c7a1" member_type: VOTER } }
I20251214 21:03:51.902338 25208 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c25810183da0499480a6725af1a2c7a1. Latest consensus state: current_term: 1 leader_uuid: "c25810183da0499480a6725af1a2c7a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25810183da0499480a6725af1a2c7a1" member_type: VOTER } }
I20251214 21:03:51.902419 25208 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [sys.catalog]: This master's current role is: LEADER
I20251214 21:03:51.902410 25207 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [sys.catalog]: This master's current role is: LEADER
I20251214 21:03:51.902664 25211 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:03:51.903419 25211 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:03:51.903613 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:03:51.905042 25211 catalog_manager.cc:1357] Generated new cluster ID: be5775df9bf7466fa8aa7193186b9b4a
I20251214 21:03:51.905105 25211 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:03:51.915289 25211 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:03:51.915839 25211 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:03:51.919787 25211 catalog_manager.cc:6027] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1: Generated new TSK 0
I20251214 21:03:51.919922 25211 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:03:51.935976 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:51.937914 25225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:51.937928 25224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:51.938077 25227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:51.937954 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:51.938295 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:51.938340 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:51.938354 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746231938355 us; error 0 us; skew 500 ppm
I20251214 21:03:51.939319 20608 webserver.cc:492] Webserver started at http://127.20.32.1:38693/ using document root <none> and password file <none>
I20251214 21:03:51.939457 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:51.939504 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:51.939576 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:51.939960 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07"
format_stamp: "Formatted at 2025-12-14 21:03:51 on dist-test-slave-bphs"
I20251214 21:03:51.941315 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:51.942221 25232 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:51.942436 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:51.942494 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07"
format_stamp: "Formatted at 2025-12-14 21:03:51 on dist-test-slave-bphs"
I20251214 21:03:51.942560 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:51.952453 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:51.952811 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:51.953109 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:51.953574 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:51.953727 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:51.953830 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:51.953858 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:51.958202 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:40169
I20251214 21:03:51.959177 25295 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:40169 every 8 connection(s)
I20251214 21:03:51.959537 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:51.961572 25303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:51.961678 25300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:51.961843 25301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:51.961846 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:51.962107 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:51.962159 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:51.962175 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746231962175 us; error 0 us; skew 500 ppm
I20251214 21:03:51.963035 20608 webserver.cc:492] Webserver started at http://127.20.32.2:41529/ using document root <none> and password file <none>
I20251214 21:03:51.963182 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:51.963234 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:51.963315 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:51.963680 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "b9c41368496242ba8ab9e0944999dbd6"
format_stamp: "Formatted at 2025-12-14 21:03:51 on dist-test-slave-bphs"
I20251214 21:03:51.964200 25296 heartbeater.cc:344] Connected to a master server at 127.20.32.62:46679
I20251214 21:03:51.964298 25296 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:51.964527 25296 heartbeater.cc:507] Master 127.20.32.62:46679 requested a full tablet report, sending...
I20251214 21:03:51.965135 25167 ts_manager.cc:194] Registered new tserver with Master: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1:40169)
I20251214 21:03:51.965382 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:03:51.966008 25167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46690
I20251214 21:03:51.966373 25308 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:51.966635 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:51.966703 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "b9c41368496242ba8ab9e0944999dbd6"
format_stamp: "Formatted at 2025-12-14 21:03:51 on dist-test-slave-bphs"
I20251214 21:03:51.966773 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:51.989454 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:51.989890 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:51.990155 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:51.990603 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:51.990641 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:51.990670 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:51.990684 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:51.994781 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:33529
I20251214 21:03:51.994813 25371 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:33529 every 8 connection(s)
I20251214 21:03:51.995574 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:51.997267 25376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:51.997315 25375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:51.997886 25378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:51.998324 20608 server_base.cc:1047] running on GCE node
I20251214 21:03:51.998502 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:51.998553 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:51.998574 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746231998574 us; error 0 us; skew 500 ppm
I20251214 21:03:51.999425 20608 webserver.cc:492] Webserver started at http://127.20.32.3:40009/ using document root <none> and password file <none>
I20251214 21:03:51.999536 25372 heartbeater.cc:344] Connected to a master server at 127.20.32.62:46679
I20251214 21:03:51.999573 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:51.999619 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:51.999629 25372 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:51.999688 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:51.999850 25372 heartbeater.cc:507] Master 127.20.32.62:46679 requested a full tablet report, sending...
I20251214 21:03:52.000157 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "ded0f114e12743eea76b984cec2f4491"
format_stamp: "Formatted at 2025-12-14 21:03:51 on dist-test-slave-bphs"
I20251214 21:03:52.000473 25167 ts_manager.cc:194] Registered new tserver with Master: b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529)
I20251214 21:03:52.000993 25167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46698
I20251214 21:03:52.001629 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:03:52.002539 25383 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:52.002738 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:52.002799 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "ded0f114e12743eea76b984cec2f4491"
format_stamp: "Formatted at 2025-12-14 21:03:51 on dist-test-slave-bphs"
I20251214 21:03:52.002863 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:52.013190 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:52.013568 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:52.013888 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:52.014340 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:52.014377 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:52.014417 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:52.014444 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:52.018414 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:33957
I20251214 21:03:52.018467 25446 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:33957 every 8 connection(s)
I20251214 21:03:52.022848 25447 heartbeater.cc:344] Connected to a master server at 127.20.32.62:46679
I20251214 21:03:52.022949 25447 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:52.023173 25447 heartbeater.cc:507] Master 127.20.32.62:46679 requested a full tablet report, sending...
I20251214 21:03:52.023808 25167 ts_manager.cc:194] Registered new tserver with Master: ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957)
I20251214 21:03:52.024333 25167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46706
I20251214 21:03:52.024581 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005771438s
I20251214 21:03:52.967012 25296 heartbeater.cc:499] Master 127.20.32.62:46679 was elected leader, sending a full tablet report...
I20251214 21:03:53.001888 25372 heartbeater.cc:499] Master 127.20.32.62:46679 was elected leader, sending a full tablet report...
I20251214 21:03:53.025194 25447 heartbeater.cc:499] Master 127.20.32.62:46679 was elected leader, sending a full tablet report...
I20251214 21:03:53.051113 20608 test_util.cc:276] Using random seed: -721680415
I20251214 21:03:53.059129 25167 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46708:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\252\252\252*\004\001\000TUUU""\004\001\000\252\252\252*\004\001\000TUUU"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:03:53.059623 25167 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:03:53.069615 25411 tablet_service.cc:1505] Processing CreateTablet for tablet 7536099b91df41f593c375e613f62698 (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION VALUES < 715827882
I20251214 21:03:53.069821 25409 tablet_service.cc:1505] Processing CreateTablet for tablet 2f4301560c8840aa86e80707aaa45b6f (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20251214 21:03:53.069990 25411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7536099b91df41f593c375e613f62698. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.069615 25410 tablet_service.cc:1505] Processing CreateTablet for tablet 58f0a0a65e5047f8b1241ec95ac15e84 (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20251214 21:03:53.070246 25410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f0a0a65e5047f8b1241ec95ac15e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.070209 25335 tablet_service.cc:1505] Processing CreateTablet for tablet 58f0a0a65e5047f8b1241ec95ac15e84 (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20251214 21:03:53.069957 25336 tablet_service.cc:1505] Processing CreateTablet for tablet 7536099b91df41f593c375e613f62698 (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION VALUES < 715827882
I20251214 21:03:53.070480 25335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f0a0a65e5047f8b1241ec95ac15e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.071091 25334 tablet_service.cc:1505] Processing CreateTablet for tablet 2f4301560c8840aa86e80707aaa45b6f (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20251214 21:03:53.071527 25334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4301560c8840aa86e80707aaa45b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.072016 25260 tablet_service.cc:1505] Processing CreateTablet for tablet 7536099b91df41f593c375e613f62698 (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION VALUES < 715827882
I20251214 21:03:53.072248 25260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7536099b91df41f593c375e613f62698. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.072862 25409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4301560c8840aa86e80707aaa45b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.073815 25259 tablet_service.cc:1505] Processing CreateTablet for tablet 58f0a0a65e5047f8b1241ec95ac15e84 (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20251214 21:03:53.074044 25259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f0a0a65e5047f8b1241ec95ac15e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.074946 25469 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Bootstrap starting.
I20251214 21:03:53.075392 25467 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491: Bootstrap starting.
I20251214 21:03:53.075835 25469 tablet_bootstrap.cc:654] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.075979 25258 tablet_service.cc:1505] Processing CreateTablet for tablet 2f4301560c8840aa86e80707aaa45b6f (DEFAULT_TABLE table=test-workload [id=638b23af271c45d8a6a335b65bc06eb9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20251214 21:03:53.076224 25258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4301560c8840aa86e80707aaa45b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.076241 25467 tablet_bootstrap.cc:654] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.076923 25469 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: No bootstrap required, opened a new log
I20251214 21:03:53.077006 25469 ts_tablet_manager.cc:1403] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:03:53.077356 25467 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491: No bootstrap required, opened a new log
I20251214 21:03:53.077430 25467 ts_tablet_manager.cc:1403] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:53.077442 25469 raft_consensus.cc:359] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.077526 25469 raft_consensus.cc:385] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:53.077545 25469 raft_consensus.cc:740] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.077646 25469 consensus_queue.cc:260] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.077849 25467 raft_consensus.cc:359] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.077951 25467 raft_consensus.cc:385] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:53.077983 25469 ts_tablet_manager.cc:1434] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:53.077989 25467 raft_consensus.cc:740] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ded0f114e12743eea76b984cec2f4491, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.078179 25469 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Bootstrap starting.
I20251214 21:03:53.078132 25467 consensus_queue.cc:260] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.078408 25336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7536099b91df41f593c375e613f62698. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:53.078483 25467 ts_tablet_manager.cc:1434] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:53.078661 25467 tablet_bootstrap.cc:492] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491: Bootstrap starting.
I20251214 21:03:53.079087 25469 tablet_bootstrap.cc:654] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.079746 25467 tablet_bootstrap.cc:654] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.080930 25467 tablet_bootstrap.cc:492] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491: No bootstrap required, opened a new log
I20251214 21:03:53.081017 25467 ts_tablet_manager.cc:1403] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:03:53.081544 25467 raft_consensus.cc:359] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.081650 25467 raft_consensus.cc:385] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:53.081681 25467 raft_consensus.cc:740] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ded0f114e12743eea76b984cec2f4491, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.081836 25468 tablet_bootstrap.cc:492] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6: Bootstrap starting.
I20251214 21:03:53.081815 25467 consensus_queue.cc:260] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.082141 25467 ts_tablet_manager.cc:1434] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:53.082329 25467 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: Bootstrap starting.
I20251214 21:03:53.082720 25468 tablet_bootstrap.cc:654] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.083161 25467 tablet_bootstrap.cc:654] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.083755 25469 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: No bootstrap required, opened a new log
I20251214 21:03:53.083801 25474 raft_consensus.cc:493] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:53.083844 25469 ts_tablet_manager.cc:1403] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251214 21:03:53.083871 25474 raft_consensus.cc:515] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.084247 25469 raft_consensus.cc:359] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.084339 25474 leader_election.cc:290] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529), ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957)
I20251214 21:03:53.084352 25469 raft_consensus.cc:385] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:53.084416 25469 raft_consensus.cc:740] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.084520 25469 consensus_queue.cc:260] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.084753 25469 ts_tablet_manager.cc:1434] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:53.084909 25469 tablet_bootstrap.cc:492] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Bootstrap starting.
I20251214 21:03:53.084915 25468 tablet_bootstrap.cc:492] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6: No bootstrap required, opened a new log
I20251214 21:03:53.085058 25468 ts_tablet_manager.cc:1403] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251214 21:03:53.085426 25468 raft_consensus.cc:359] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.085508 25468 raft_consensus.cc:385] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:53.085537 25468 raft_consensus.cc:740] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c41368496242ba8ab9e0944999dbd6, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.085673 25468 consensus_queue.cc:260] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.085826 25469 tablet_bootstrap.cc:654] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.086004 25468 ts_tablet_manager.cc:1434] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:53.086414 25468 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6: Bootstrap starting.
I20251214 21:03:53.087361 25468 tablet_bootstrap.cc:654] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.088333 25468 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6: No bootstrap required, opened a new log
I20251214 21:03:53.089164 25346 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7536099b91df41f593c375e613f62698" candidate_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c41368496242ba8ab9e0944999dbd6" is_pre_election: true
I20251214 21:03:53.089243 25467 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: No bootstrap required, opened a new log
I20251214 21:03:53.089284 25468 ts_tablet_manager.cc:1403] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251214 21:03:53.089313 25467 ts_tablet_manager.cc:1403] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
W20251214 21:03:53.089543 25234 leader_election.cc:343] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529): Illegal state: must be running to vote when last-logged opid is not known
I20251214 21:03:53.089681 25467 raft_consensus.cc:359] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.089799 25467 raft_consensus.cc:385] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:53.089834 25467 raft_consensus.cc:740] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ded0f114e12743eea76b984cec2f4491, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.089941 25468 raft_consensus.cc:359] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.089967 25467 consensus_queue.cc:260] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.090058 25468 raft_consensus.cc:385] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:53.090104 25468 raft_consensus.cc:740] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c41368496242ba8ab9e0944999dbd6, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.090242 25468 consensus_queue.cc:260] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.090478 25468 ts_tablet_manager.cc:1434] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:03:53.090535 25469 tablet_bootstrap.cc:492] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: No bootstrap required, opened a new log
I20251214 21:03:53.090619 25469 ts_tablet_manager.cc:1403] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251214 21:03:53.090986 25469 raft_consensus.cc:359] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.091071 25469 raft_consensus.cc:385] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:03:53.091102 25469 raft_consensus.cc:740] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.091207 25469 consensus_queue.cc:260] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.091459 25469 ts_tablet_manager.cc:1434] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:53.091495 25467 ts_tablet_manager.cc:1434] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251214 21:03:53.092105 25421 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7536099b91df41f593c375e613f62698" candidate_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ded0f114e12743eea76b984cec2f4491" is_pre_election: true
I20251214 21:03:53.092156 25468 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6: Bootstrap starting.
I20251214 21:03:53.092234 25421 raft_consensus.cc:2468] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 in term 0.
I20251214 21:03:53.092528 25234 leader_election.cc:304] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, ded0f114e12743eea76b984cec2f4491; no voters: b9c41368496242ba8ab9e0944999dbd6
I20251214 21:03:53.092841 25472 raft_consensus.cc:2804] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:53.092895 25472 raft_consensus.cc:493] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:53.092952 25472 raft_consensus.cc:3060] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.093394 25468 tablet_bootstrap.cc:654] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6: Neither blocks nor log segments found. Creating new log.
I20251214 21:03:53.094017 25472 raft_consensus.cc:515] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.094344 25472 leader_election.cc:290] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 election: Requested vote from peers b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529), ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957)
I20251214 21:03:53.094476 25468 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6: No bootstrap required, opened a new log
I20251214 21:03:53.094581 25468 ts_tablet_manager.cc:1403] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251214 21:03:53.094594 25346 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7536099b91df41f593c375e613f62698" candidate_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c41368496242ba8ab9e0944999dbd6"
I20251214 21:03:53.094594 25421 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7536099b91df41f593c375e613f62698" candidate_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ded0f114e12743eea76b984cec2f4491"
I20251214 21:03:53.094799 25421 raft_consensus.cc:3060] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.095050 25468 raft_consensus.cc:359] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.095145 25468 raft_consensus.cc:385] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251214 21:03:53.095150 25234 leader_election.cc:343] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529): Illegal state: must be running to vote when last-logged opid is not known
I20251214 21:03:53.095193 25468 raft_consensus.cc:740] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c41368496242ba8ab9e0944999dbd6, State: Initialized, Role: FOLLOWER
I20251214 21:03:53.095316 25468 consensus_queue.cc:260] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.095568 25468 ts_tablet_manager.cc:1434] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:53.095626 25421 raft_consensus.cc:2468] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 in term 1.
I20251214 21:03:53.095860 25234 leader_election.cc:304] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, ded0f114e12743eea76b984cec2f4491; no voters: b9c41368496242ba8ab9e0944999dbd6
I20251214 21:03:53.096047 25472 raft_consensus.cc:2804] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:53.096129 25472 raft_consensus.cc:697] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 LEADER]: Becoming Leader. State: Replica: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, State: Running, Role: LEADER
I20251214 21:03:53.096235 25472 consensus_queue.cc:237] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.097563 25167 catalog_manager.cc:5654] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } health_report { overall_health: HEALTHY } } }
I20251214 21:03:53.112421 25473 raft_consensus.cc:493] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:53.112560 25473 raft_consensus.cc:515] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.113081 25473 leader_election.cc:290] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1:40169), b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529)
I20251214 21:03:53.116325 25346 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58f0a0a65e5047f8b1241ec95ac15e84" candidate_uuid: "ded0f114e12743eea76b984cec2f4491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c41368496242ba8ab9e0944999dbd6" is_pre_election: true
I20251214 21:03:53.116333 25270 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58f0a0a65e5047f8b1241ec95ac15e84" candidate_uuid: "ded0f114e12743eea76b984cec2f4491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" is_pre_election: true
I20251214 21:03:53.116487 25270 raft_consensus.cc:2468] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ded0f114e12743eea76b984cec2f4491 in term 0.
I20251214 21:03:53.116487 25346 raft_consensus.cc:2468] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ded0f114e12743eea76b984cec2f4491 in term 0.
I20251214 21:03:53.116793 25386 leader_election.cc:304] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, b9c41368496242ba8ab9e0944999dbd6, ded0f114e12743eea76b984cec2f4491; no voters:
I20251214 21:03:53.116973 25473 raft_consensus.cc:2804] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:53.117046 25473 raft_consensus.cc:493] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:53.117077 25473 raft_consensus.cc:3060] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.117981 25473 raft_consensus.cc:515] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.118309 25473 leader_election.cc:290] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [CANDIDATE]: Term 1 election: Requested vote from peers 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1:40169), b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529)
I20251214 21:03:53.118618 25346 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58f0a0a65e5047f8b1241ec95ac15e84" candidate_uuid: "ded0f114e12743eea76b984cec2f4491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c41368496242ba8ab9e0944999dbd6"
I20251214 21:03:53.118618 25270 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58f0a0a65e5047f8b1241ec95ac15e84" candidate_uuid: "ded0f114e12743eea76b984cec2f4491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07"
I20251214 21:03:53.118762 25346 raft_consensus.cc:3060] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.118762 25270 raft_consensus.cc:3060] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.119745 25270 raft_consensus.cc:2468] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ded0f114e12743eea76b984cec2f4491 in term 1.
I20251214 21:03:53.119745 25346 raft_consensus.cc:2468] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ded0f114e12743eea76b984cec2f4491 in term 1.
I20251214 21:03:53.120034 25386 leader_election.cc:304] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, ded0f114e12743eea76b984cec2f4491; no voters:
I20251214 21:03:53.120251 25473 raft_consensus.cc:2804] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:53.120337 25473 raft_consensus.cc:697] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 1 LEADER]: Becoming Leader. State: Replica: ded0f114e12743eea76b984cec2f4491, State: Running, Role: LEADER
I20251214 21:03:53.120461 25473 consensus_queue.cc:237] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.121919 25167 catalog_manager.cc:5654] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 reported cstate change: term changed from 0 to 1, leader changed from <none> to ded0f114e12743eea76b984cec2f4491 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "ded0f114e12743eea76b984cec2f4491" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } health_report { overall_health: HEALTHY } } }
I20251214 21:03:53.155699 25472 raft_consensus.cc:493] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:53.155853 25472 raft_consensus.cc:515] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.156316 25472 leader_election.cc:290] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529), ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957)
I20251214 21:03:53.156843 25421 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f4301560c8840aa86e80707aaa45b6f" candidate_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ded0f114e12743eea76b984cec2f4491" is_pre_election: true
I20251214 21:03:53.156843 25346 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f4301560c8840aa86e80707aaa45b6f" candidate_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c41368496242ba8ab9e0944999dbd6" is_pre_election: true
I20251214 21:03:53.157024 25346 raft_consensus.cc:2468] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 in term 0.
I20251214 21:03:53.157024 25421 raft_consensus.cc:2468] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 in term 0.
I20251214 21:03:53.157377 25234 leader_election.cc:304] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, b9c41368496242ba8ab9e0944999dbd6; no voters:
I20251214 21:03:53.157564 25472 raft_consensus.cc:2804] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:03:53.157634 25472 raft_consensus.cc:493] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:03:53.157753 25472 raft_consensus.cc:3060] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.158610 25472 raft_consensus.cc:515] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.158939 25472 leader_election.cc:290] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 election: Requested vote from peers b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529), ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957)
I20251214 21:03:53.159298 25346 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f4301560c8840aa86e80707aaa45b6f" candidate_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c41368496242ba8ab9e0944999dbd6"
I20251214 21:03:53.159324 25421 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f4301560c8840aa86e80707aaa45b6f" candidate_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ded0f114e12743eea76b984cec2f4491"
I20251214 21:03:53.159428 25346 raft_consensus.cc:3060] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.159456 25421 raft_consensus.cc:3060] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.160382 25421 raft_consensus.cc:2468] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 in term 1.
I20251214 21:03:53.160470 25346 raft_consensus.cc:2468] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 in term 1.
I20251214 21:03:53.160723 25234 leader_election.cc:304] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, ded0f114e12743eea76b984cec2f4491; no voters:
I20251214 21:03:53.160903 25472 raft_consensus.cc:2804] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:03:53.160983 25472 raft_consensus.cc:697] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 LEADER]: Becoming Leader. State: Replica: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, State: Running, Role: LEADER
I20251214 21:03:53.161100 25472 consensus_queue.cc:237] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } }
I20251214 21:03:53.161841 25482 raft_consensus.cc:493] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:03:53.161923 25482 raft_consensus.cc:515] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } }
I20251214 21:03:53.162324 25482 leader_election.cc:290] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957), 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1:40169)
I20251214 21:03:53.162670 25167 catalog_manager.cc:5654] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:53.165786 25270 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7536099b91df41f593c375e613f62698" candidate_uuid: "b9c41368496242ba8ab9e0944999dbd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" is_pre_election: true
I20251214 21:03:53.165900 25421 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7536099b91df41f593c375e613f62698" candidate_uuid: "b9c41368496242ba8ab9e0944999dbd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ded0f114e12743eea76b984cec2f4491" is_pre_election: true
I20251214 21:03:53.166043 25421 raft_consensus.cc:2393] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c41368496242ba8ab9e0944999dbd6 in current term 1: Already voted for candidate 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 in this term.
I20251214 21:03:53.166245 25310 leader_election.cc:304] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c41368496242ba8ab9e0944999dbd6; no voters: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, ded0f114e12743eea76b984cec2f4491
I20251214 21:03:53.166410 25482 raft_consensus.cc:3060] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:03:53.167198 25482 raft_consensus.cc:2749] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251214 21:03:53.184795 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:03:53.186746 25494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:03:53.186772 25496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:53.186854 20608 server_base.cc:1047] running on GCE node
W20251214 21:03:53.186866 25493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:03:53.187234 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:03:53.187278 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:03:53.187294 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746233187294 us; error 0 us; skew 500 ppm
I20251214 21:03:53.188220 20608 webserver.cc:492] Webserver started at http://127.20.32.4:33121/ using document root <none> and password file <none>
I20251214 21:03:53.188357 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:03:53.188410 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:03:53.188460 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:03:53.188807 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-3-root/instance:
uuid: "2b925c37b81d4dd485b11dd164b2f632"
format_stamp: "Formatted at 2025-12-14 21:03:53 on dist-test-slave-bphs"
I20251214 21:03:53.190233 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:03:53.191182 25501 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:53.191430 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:03:53.191498 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-3-root
uuid: "2b925c37b81d4dd485b11dd164b2f632"
format_stamp: "Formatted at 2025-12-14 21:03:53 on dist-test-slave-bphs"
I20251214 21:03:53.191568 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:03:53.198367 25472 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:03:53.200196 25474 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20251214 21:03:53.200256 25474 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20251214 21:03:53.201352 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:03:53.201813 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:03:53.202116 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:03:53.202589 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:03:53.202628 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:53.202666 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:03:53.202694 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:03:53.202849 25473 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:53.206408 25535 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:53.208735 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.4:38137
I20251214 21:03:53.209383 25571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.4:38137 every 8 connection(s)
W20251214 21:03:53.210585 25297 tablet.cc:2378] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:03:53.212813 25572 heartbeater.cc:344] Connected to a master server at 127.20.32.62:46679
I20251214 21:03:53.212915 25572 heartbeater.cc:461] Registering TS with master...
I20251214 21:03:53.213157 25572 heartbeater.cc:507] Master 127.20.32.62:46679 requested a full tablet report, sending...
I20251214 21:03:53.213807 25167 ts_manager.cc:194] Registered new tserver with Master: 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4:38137)
I20251214 21:03:53.214376 25167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46718
I20251214 21:03:53.242789 25477 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:53.246842 25535 consensus_queue.cc:1048] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:53.281193 25535 consensus_queue.cc:1048] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:03:53.903760 25221 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:53.908963 25270 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7536099b91df41f593c375e613f62698"
dest_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07"
mode: GRACEFUL
new_leader_uuid: "b9c41368496242ba8ab9e0944999dbd6"
from {username='slave'} at 127.0.0.1:56382
I20251214 21:03:53.909420 25269 consensus_queue.cc:237] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:53.910229 25270 raft_consensus.cc:606] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 LEADER]: Received request to transfer leadership to TS b9c41368496242ba8ab9e0944999dbd6
I20251214 21:03:53.910868 25421 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Refusing update from remote peer 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:53.910928 25345 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Refusing update from remote peer 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:53.911202 25221 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20251214 21:03:53.911306 25221 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:53.911453 25584 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:03:53.911643 25472 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:03:53.913683 25345 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } } }
I20251214 21:03:53.913861 25421 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } } }
W20251214 21:03:53.915452 25236 consensus_peers.cc:597] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 -> Peer 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4:38137): Couldn't send request to peer 2b925c37b81d4dd485b11dd164b2f632. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7536099b91df41f593c375e613f62698. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:53.916293 25167 catalog_manager.cc:5654] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } } }
I20251214 21:03:53.999192 25472 raft_consensus.cc:993] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: : Instructing follower b9c41368496242ba8ab9e0944999dbd6 to start an election
I20251214 21:03:53.999364 25472 raft_consensus.cc:1081] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 LEADER]: Signalling peer b9c41368496242ba8ab9e0944999dbd6 to start an election
I20251214 21:03:53.999892 25345 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7536099b91df41f593c375e613f62698"
dest_uuid: "b9c41368496242ba8ab9e0944999dbd6"
from {username='slave'} at 127.0.0.1:44298
I20251214 21:03:54.000041 25345 raft_consensus.cc:493] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:03:54.000100 25345 raft_consensus.cc:3060] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:54.000977 25345 raft_consensus.cc:515] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:54.001333 25345 leader_election.cc:290] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [CANDIDATE]: Term 2 election: Requested vote from peers ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957), 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1:40169)
I20251214 21:03:54.001690 25270 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7536099b91df41f593c375e613f62698" candidate_uuid: "b9c41368496242ba8ab9e0944999dbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07"
I20251214 21:03:54.001773 25421 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7536099b91df41f593c375e613f62698" candidate_uuid: "b9c41368496242ba8ab9e0944999dbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ded0f114e12743eea76b984cec2f4491"
I20251214 21:03:54.001824 25270 raft_consensus.cc:3055] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:03:54.001870 25270 raft_consensus.cc:740] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6a7ad61eac7a4d9dbc0c8a33c1a3fb07, State: Running, Role: LEADER
I20251214 21:03:54.001878 25421 raft_consensus.cc:3060] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:54.002041 25270 consensus_queue.cc:260] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:54.002215 25270 raft_consensus.cc:3060] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:03:54.002744 25421 raft_consensus.cc:2468] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c41368496242ba8ab9e0944999dbd6 in term 2.
I20251214 21:03:54.003013 25310 leader_election.cc:304] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c41368496242ba8ab9e0944999dbd6, ded0f114e12743eea76b984cec2f4491; no voters:
I20251214 21:03:54.003018 25270 raft_consensus.cc:2468] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c41368496242ba8ab9e0944999dbd6 in term 2.
I20251214 21:03:54.003235 25587 raft_consensus.cc:2804] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:03:54.003465 25587 raft_consensus.cc:697] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 2 LEADER]: Becoming Leader. State: Replica: b9c41368496242ba8ab9e0944999dbd6, State: Running, Role: LEADER
I20251214 21:03:54.003609 25587 consensus_queue.cc:237] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:54.005151 25165 catalog_manager.cc:5654] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 reported cstate change: term changed from 1 to 2, leader changed from 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1) to b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "b9c41368496242ba8ab9e0944999dbd6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:03:54.083542 25270 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Refusing update from remote peer b9c41368496242ba8ab9e0944999dbd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:03:54.083937 25587 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:03:54.084555 25270 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } } }
I20251214 21:03:54.090241 25421 consensus_queue.cc:237] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:54.091634 25270 raft_consensus.cc:1275] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Refusing update from remote peer ded0f114e12743eea76b984cec2f4491: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:54.091732 25345 raft_consensus.cc:1275] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Refusing update from remote peer ded0f114e12743eea76b984cec2f4491: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:03:54.091974 25595 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:03:54.092161 25477 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:03:54.093935 25345 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } } }
I20251214 21:03:54.093994 25270 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } } }
W20251214 21:03:54.095499 25387 consensus_peers.cc:597] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 -> Peer 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4:38137): Couldn't send request to peer 2b925c37b81d4dd485b11dd164b2f632. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58f0a0a65e5047f8b1241ec95ac15e84. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:54.096069 25165 catalog_manager.cc:5654] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "ded0f114e12743eea76b984cec2f4491" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } } }
W20251214 21:03:54.122330 25312 consensus_peers.cc:597] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 -> Peer 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4:38137): Couldn't send request to peer 2b925c37b81d4dd485b11dd164b2f632. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7536099b91df41f593c375e613f62698. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:03:54.127300 25421 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 2 FOLLOWER]: Refusing update from remote peer b9c41368496242ba8ab9e0944999dbd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:03:54.127691 25587 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:03:54.133692 25477 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } } }
I20251214 21:03:54.188532 25601 ts_tablet_manager.cc:933] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: Initiating tablet copy from peer ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957)
I20251214 21:03:54.188927 25601 tablet_copy_client.cc:323] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:33957
I20251214 21:03:54.192606 25431 tablet_copy_service.cc:140] P ded0f114e12743eea76b984cec2f4491: Received BeginTabletCopySession request for tablet 58f0a0a65e5047f8b1241ec95ac15e84 from peer 2b925c37b81d4dd485b11dd164b2f632 ({username='slave'} at 127.0.0.1:56296)
I20251214 21:03:54.192725 25431 tablet_copy_service.cc:161] P ded0f114e12743eea76b984cec2f4491: Beginning new tablet copy session on tablet 58f0a0a65e5047f8b1241ec95ac15e84 from peer 2b925c37b81d4dd485b11dd164b2f632 at {username='slave'} at 127.0.0.1:56296: session id = 2b925c37b81d4dd485b11dd164b2f632-58f0a0a65e5047f8b1241ec95ac15e84
I20251214 21:03:54.193655 25431 tablet_copy_source_session.cc:215] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:54.194509 25601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f0a0a65e5047f8b1241ec95ac15e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:54.196532 25601 tablet_copy_client.cc:806] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:54.196677 25601 tablet_copy_client.cc:670] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:54.197613 25601 tablet_copy_client.cc:538] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:54.198910 25601 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: Bootstrap starting.
I20251214 21:03:54.202389 25601 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:54.202610 25601 tablet_bootstrap.cc:492] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: Bootstrap complete.
I20251214 21:03:54.202768 25601 ts_tablet_manager.cc:1403] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20251214 21:03:54.203227 25601 raft_consensus.cc:359] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:54.203344 25601 raft_consensus.cc:740] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b925c37b81d4dd485b11dd164b2f632, State: Initialized, Role: LEARNER
I20251214 21:03:54.203445 25601 consensus_queue.cc:260] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:54.203830 25601 ts_tablet_manager.cc:1434] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:03:54.203855 25572 heartbeater.cc:499] Master 127.20.32.62:46679 was elected leader, sending a full tablet report...
I20251214 21:03:54.204206 25431 tablet_copy_service.cc:342] P ded0f114e12743eea76b984cec2f4491: Request end of tablet copy session 2b925c37b81d4dd485b11dd164b2f632-58f0a0a65e5047f8b1241ec95ac15e84 received from {username='slave'} at 127.0.0.1:56296
I20251214 21:03:54.204277 25431 tablet_copy_service.cc:434] P ded0f114e12743eea76b984cec2f4491: ending tablet copy session 2b925c37b81d4dd485b11dd164b2f632-58f0a0a65e5047f8b1241ec95ac15e84 on tablet 58f0a0a65e5047f8b1241ec95ac15e84 with peer 2b925c37b81d4dd485b11dd164b2f632
I20251214 21:03:54.227913 25601 ts_tablet_manager.cc:933] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: Initiating tablet copy from peer b9c41368496242ba8ab9e0944999dbd6 (127.20.32.2:33529)
I20251214 21:03:54.228322 25601 tablet_copy_client.cc:323] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:33529
I20251214 21:03:54.231612 25356 tablet_copy_service.cc:140] P b9c41368496242ba8ab9e0944999dbd6: Received BeginTabletCopySession request for tablet 7536099b91df41f593c375e613f62698 from peer 2b925c37b81d4dd485b11dd164b2f632 ({username='slave'} at 127.0.0.1:44314)
I20251214 21:03:54.231712 25356 tablet_copy_service.cc:161] P b9c41368496242ba8ab9e0944999dbd6: Beginning new tablet copy session on tablet 7536099b91df41f593c375e613f62698 from peer 2b925c37b81d4dd485b11dd164b2f632 at {username='slave'} at 127.0.0.1:44314: session id = 2b925c37b81d4dd485b11dd164b2f632-7536099b91df41f593c375e613f62698
I20251214 21:03:54.232537 25356 tablet_copy_source_session.cc:215] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:03:54.233263 25601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7536099b91df41f593c375e613f62698. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:03:54.235214 25601 tablet_copy_client.cc:806] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: tablet copy: Starting download of 0 data blocks...
I20251214 21:03:54.235358 25601 tablet_copy_client.cc:670] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: tablet copy: Starting download of 1 WAL segments...
I20251214 21:03:54.236455 25601 tablet_copy_client.cc:538] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:03:54.238044 25601 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: Bootstrap starting.
I20251214 21:03:54.241662 25601 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:03:54.241943 25601 tablet_bootstrap.cc:492] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: Bootstrap complete.
I20251214 21:03:54.242118 25601 ts_tablet_manager.cc:1403] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20251214 21:03:54.242595 25601 raft_consensus.cc:359] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:54.242718 25601 raft_consensus.cc:740] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 2b925c37b81d4dd485b11dd164b2f632, State: Initialized, Role: LEARNER
I20251214 21:03:54.242799 25601 consensus_queue.cc:260] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: true } }
I20251214 21:03:54.243073 25601 ts_tablet_manager.cc:1434] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:03:54.243510 25356 tablet_copy_service.cc:342] P b9c41368496242ba8ab9e0944999dbd6: Request end of tablet copy session 2b925c37b81d4dd485b11dd164b2f632-7536099b91df41f593c375e613f62698 received from {username='slave'} at 127.0.0.1:44314
I20251214 21:03:54.243599 25356 tablet_copy_service.cc:434] P b9c41368496242ba8ab9e0944999dbd6: ending tablet copy session 2b925c37b81d4dd485b11dd164b2f632-7536099b91df41f593c375e613f62698 on tablet 7536099b91df41f593c375e613f62698 with peer 2b925c37b81d4dd485b11dd164b2f632
I20251214 21:03:54.288657 25538 raft_consensus.cc:1217] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251214 21:03:54.352464 25538 raft_consensus.cc:1217] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20251214 21:03:54.454089 25595 raft_consensus.cc:1064] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491: attempting to promote NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 to VOTER
I20251214 21:03:54.454581 25595 consensus_queue.cc:237] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } }
I20251214 21:03:54.455906 25345 raft_consensus.cc:1275] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Refusing update from remote peer ded0f114e12743eea76b984cec2f4491: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:03:54.455958 25270 raft_consensus.cc:1275] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Refusing update from remote peer ded0f114e12743eea76b984cec2f4491: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:03:54.456015 25538 raft_consensus.cc:1275] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 LEARNER]: Refusing update from remote peer ded0f114e12743eea76b984cec2f4491: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:03:54.456233 25594 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:03:54.456425 25477 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:03:54.456691 25477 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:03:54.458989 25345 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.459367 25538 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.461408 25167 catalog_manager.cc:5654] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 reported cstate change: config changed from index 2 to 3, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ded0f114e12743eea76b984cec2f4491" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.462797 25594 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.464639 25270 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } attrs { replace: true } } peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.523938 25591 raft_consensus.cc:1064] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6: attempting to promote NON_VOTER 2b925c37b81d4dd485b11dd164b2f632 to VOTER
I20251214 21:03:54.524436 25591 consensus_queue.cc:237] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } }
I20251214 21:03:54.525532 25538 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 LEARNER]: Refusing update from remote peer b9c41368496242ba8ab9e0944999dbd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:03:54.525640 25270 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Refusing update from remote peer b9c41368496242ba8ab9e0944999dbd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:03:54.525651 25420 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 2 FOLLOWER]: Refusing update from remote peer b9c41368496242ba8ab9e0944999dbd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:03:54.525918 25612 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:03:54.526296 25600 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:03:54.526594 25587 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:03:54.528604 25538 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.528772 25420 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.545572 25420 consensus_queue.cc:237] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } }
I20251214 21:03:54.546586 25166 catalog_manager.cc:5654] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 reported cstate change: config changed from index 2 to 4, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b9c41368496242ba8ab9e0944999dbd6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.547191 25538 raft_consensus.cc:1275] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 FOLLOWER]: Refusing update from remote peer ded0f114e12743eea76b984cec2f4491: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251214 21:03:54.547454 25346 raft_consensus.cc:1275] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Refusing update from remote peer ded0f114e12743eea76b984cec2f4491: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251214 21:03:54.547827 25594 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:03:54.548192 25609 consensus_queue.cc:1048] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:03:54.549736 25346 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.550297 25538 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.582376 25612 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.584357 25270 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2b925c37b81d4dd485b11dd164b2f632 (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } attrs { replace: true } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.596472 25165 catalog_manager.cc:5654] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 reported cstate change: config changed from index 3 to 4, VOTER 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1) evicted. New cstate: current_term: 1 leader_uuid: "ded0f114e12743eea76b984cec2f4491" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.650369 25258 tablet_service.cc:1552] Processing DeleteTablet for tablet 58f0a0a65e5047f8b1241ec95ac15e84 with delete_type TABLET_DATA_TOMBSTONED (TS 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56364
I20251214 21:03:54.650840 25615 tablet_replica.cc:333] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: stopping tablet replica
I20251214 21:03:54.651053 25615 raft_consensus.cc:2243] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:54.651285 25615 raft_consensus.cc:2272] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:54.651942 25615 ts_tablet_manager.cc:1916] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:54.652441 25346 consensus_queue.cc:237] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } }
I20251214 21:03:54.653645 25538 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 FOLLOWER]: Refusing update from remote peer b9c41368496242ba8ab9e0944999dbd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251214 21:03:54.653645 25270 raft_consensus.cc:1275] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Refusing update from remote peer b9c41368496242ba8ab9e0944999dbd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20251214 21:03:54.654066 25591 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251214 21:03:54.654415 25591 consensus_queue.cc:1048] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251214 21:03:54.654567 25615 ts_tablet_manager.cc:1929] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20251214 21:03:54.654639 25615 log.cc:1199] T 58f0a0a65e5047f8b1241ec95ac15e84 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/58f0a0a65e5047f8b1241ec95ac15e84
I20251214 21:03:54.655225 25153 catalog_manager.cc:4985] TS 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1:40169): tablet 58f0a0a65e5047f8b1241ec95ac15e84 (table test-workload [id=638b23af271c45d8a6a335b65bc06eb9]) successfully deleted
I20251214 21:03:54.655907 25270 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ded0f114e12743eea76b984cec2f4491 (127.20.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.656533 25538 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ded0f114e12743eea76b984cec2f4491 (127.20.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.658427 25166 catalog_manager.cc:5654] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 reported cstate change: config changed from index 4 to 5, VOTER ded0f114e12743eea76b984cec2f4491 (127.20.32.3) evicted. New cstate: current_term: 2 leader_uuid: "b9c41368496242ba8ab9e0944999dbd6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.660882 25594 raft_consensus.cc:2955] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "ded0f114e12743eea76b984cec2f4491" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33957 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.662313 25152 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 58f0a0a65e5047f8b1241ec95ac15e84 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:54.707008 25411 tablet_service.cc:1552] Processing DeleteTablet for tablet 7536099b91df41f593c375e613f62698 with delete_type TABLET_DATA_TOMBSTONED (TS ded0f114e12743eea76b984cec2f4491 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56264
I20251214 21:03:54.707489 25616 tablet_replica.cc:333] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: stopping tablet replica
I20251214 21:03:54.707616 25616 raft_consensus.cc:2243] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:03:54.707782 25616 raft_consensus.cc:2272] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:03:54.708344 25616 ts_tablet_manager.cc:1916] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:03:54.710472 25616 ts_tablet_manager.cc:1929] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20251214 21:03:54.710547 25616 log.cc:1199] T 7536099b91df41f593c375e613f62698 P ded0f114e12743eea76b984cec2f4491: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.AutoRebalancingUnstableCluster.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/7536099b91df41f593c375e613f62698
I20251214 21:03:54.711042 25152 catalog_manager.cc:4985] TS ded0f114e12743eea76b984cec2f4491 (127.20.32.3:33957): tablet 7536099b91df41f593c375e613f62698 (table test-workload [id=638b23af271c45d8a6a335b65bc06eb9]) successfully deleted
I20251214 21:03:54.758746 25612 raft_consensus.cc:2955] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ded0f114e12743eea76b984cec2f4491 (127.20.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c41368496242ba8ab9e0944999dbd6" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 33529 } } peers { permanent_uuid: "6a7ad61eac7a4d9dbc0c8a33c1a3fb07" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 40169 } } peers { permanent_uuid: "2b925c37b81d4dd485b11dd164b2f632" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 38137 } attrs { promote: false } } }
I20251214 21:03:54.760185 25152 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 7536099b91df41f593c375e613f62698 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:03:55.911618 25221 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:55.912099 25221 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:55.912171 25221 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:57.912503 25221 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:57.912988 25221 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:57.913058 25221 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:03:59.913439 25221 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:03:59.913947 25221 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:03:59.914017 25221 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:04:01.914361 25221 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:04:01.914865 25221 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:04:01.914952 25221 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:04:02.263553 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:04:02.267720 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:02.267935 20608 tablet_replica.cc:333] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: stopping tablet replica
I20251214 21:04:02.268051 20608 raft_consensus.cc:2243] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:02.268245 20608 raft_consensus.cc:2272] T 2f4301560c8840aa86e80707aaa45b6f P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.268704 20608 tablet_replica.cc:333] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07: stopping tablet replica
I20251214 21:04:02.268776 20608 raft_consensus.cc:2243] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:02.268868 20608 raft_consensus.cc:2272] T 7536099b91df41f593c375e613f62698 P 6a7ad61eac7a4d9dbc0c8a33c1a3fb07 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.281972 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:04:02.284261 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:04:02.288177 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:02.288365 20608 tablet_replica.cc:333] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6: stopping tablet replica
I20251214 21:04:02.288487 20608 raft_consensus.cc:2243] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:04:02.288677 20608 raft_consensus.cc:2272] T 7536099b91df41f593c375e613f62698 P b9c41368496242ba8ab9e0944999dbd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.289093 20608 tablet_replica.cc:333] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6: stopping tablet replica
I20251214 21:04:02.289176 20608 raft_consensus.cc:2243] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:02.289260 20608 raft_consensus.cc:2272] T 2f4301560c8840aa86e80707aaa45b6f P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.289570 20608 tablet_replica.cc:333] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6: stopping tablet replica
I20251214 21:04:02.289636 20608 raft_consensus.cc:2243] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:02.289806 20608 raft_consensus.cc:2272] T 58f0a0a65e5047f8b1241ec95ac15e84 P b9c41368496242ba8ab9e0944999dbd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.302580 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:04:02.305351 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:04:02.309109 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:02.309305 20608 tablet_replica.cc:333] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491: stopping tablet replica
I20251214 21:04:02.309415 20608 raft_consensus.cc:2243] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:02.309614 20608 raft_consensus.cc:2272] T 58f0a0a65e5047f8b1241ec95ac15e84 P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.310112 20608 tablet_replica.cc:333] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491: stopping tablet replica
I20251214 21:04:02.310194 20608 raft_consensus.cc:2243] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:02.310283 20608 raft_consensus.cc:2272] T 2f4301560c8840aa86e80707aaa45b6f P ded0f114e12743eea76b984cec2f4491 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.323189 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:04:02.325487 20608 tablet_server.cc:178] TabletServer@127.20.32.4:0 shutting down...
I20251214 21:04:02.328997 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:02.329180 20608 tablet_replica.cc:333] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632: stopping tablet replica
I20251214 21:04:02.329298 20608 raft_consensus.cc:2243] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:02.329419 20608 raft_consensus.cc:2272] T 7536099b91df41f593c375e613f62698 P 2b925c37b81d4dd485b11dd164b2f632 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.329869 20608 tablet_replica.cc:333] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632: stopping tablet replica
I20251214 21:04:02.329942 20608 raft_consensus.cc:2243] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:02.330026 20608 raft_consensus.cc:2272] T 58f0a0a65e5047f8b1241ec95ac15e84 P 2b925c37b81d4dd485b11dd164b2f632 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.342351 20608 tablet_server.cc:195] TabletServer@127.20.32.4:0 shutdown complete.
I20251214 21:04:02.344483 20608 master.cc:561] Master@127.20.32.62:46679 shutting down...
I20251214 21:04:02.347685 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:02.347841 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:02.347900 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P c25810183da0499480a6725af1a2c7a1: stopping tablet replica
I20251214 21:04:02.361219 20608 master.cc:583] Master@127.20.32.62:46679 shutdown complete.
[ OK ] AutoRebalancerTest.AutoRebalancingUnstableCluster (10504 ms)
[ RUN ] AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor
I20251214 21:04:02.368918 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:39905
I20251214 21:04:02.369256 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:04:02.371169 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:02.371234 25626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:02.371240 25624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:02.371402 25623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:02.371574 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:02.371620 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:02.371640 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746242371640 us; error 0 us; skew 500 ppm
I20251214 21:04:02.372505 20608 webserver.cc:492] Webserver started at http://127.20.32.62:39673/ using document root <none> and password file <none>
I20251214 21:04:02.372632 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:02.372678 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:02.372732 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:02.373062 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "db91cb2e84624516854f39ec22759d96"
format_stamp: "Formatted at 2025-12-14 21:04:02 on dist-test-slave-bphs"
I20251214 21:04:02.374466 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:04:02.375268 25631 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.375515 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:02.375576 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "db91cb2e84624516854f39ec22759d96"
format_stamp: "Formatted at 2025-12-14 21:04:02 on dist-test-slave-bphs"
I20251214 21:04:02.375640 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:02.383147 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:02.383528 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:02.387641 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:39905
I20251214 21:04:02.390702 25683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:39905 every 8 connection(s)
I20251214 21:04:02.391149 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:02.392889 25684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96: Bootstrap starting.
I20251214 21:04:02.393621 25684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:02.394583 25684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96: No bootstrap required, opened a new log
I20251214 21:04:02.394919 25684 raft_consensus.cc:359] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db91cb2e84624516854f39ec22759d96" member_type: VOTER }
I20251214 21:04:02.395000 25684 raft_consensus.cc:385] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:02.395021 25684 raft_consensus.cc:740] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db91cb2e84624516854f39ec22759d96, State: Initialized, Role: FOLLOWER
I20251214 21:04:02.395110 25684 consensus_queue.cc:260] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db91cb2e84624516854f39ec22759d96" member_type: VOTER }
I20251214 21:04:02.395162 25684 raft_consensus.cc:399] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:02.395182 25684 raft_consensus.cc:493] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:02.395215 25684 raft_consensus.cc:3060] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:02.395846 25684 raft_consensus.cc:515] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db91cb2e84624516854f39ec22759d96" member_type: VOTER }
I20251214 21:04:02.395948 25684 leader_election.cc:304] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db91cb2e84624516854f39ec22759d96; no voters:
I20251214 21:04:02.396083 25684 leader_election.cc:290] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:02.396195 25687 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:02.396373 25687 raft_consensus.cc:697] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 1 LEADER]: Becoming Leader. State: Replica: db91cb2e84624516854f39ec22759d96, State: Running, Role: LEADER
I20251214 21:04:02.396457 25684 sys_catalog.cc:565] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:02.396492 25687 consensus_queue.cc:237] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db91cb2e84624516854f39ec22759d96" member_type: VOTER }
I20251214 21:04:02.396881 25688 sys_catalog.cc:455] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db91cb2e84624516854f39ec22759d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db91cb2e84624516854f39ec22759d96" member_type: VOTER } }
I20251214 21:04:02.396895 25689 sys_catalog.cc:455] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db91cb2e84624516854f39ec22759d96. Latest consensus state: current_term: 1 leader_uuid: "db91cb2e84624516854f39ec22759d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db91cb2e84624516854f39ec22759d96" member_type: VOTER } }
I20251214 21:04:02.396987 25688 sys_catalog.cc:458] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:02.396998 25689 sys_catalog.cc:458] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:02.397241 25692 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:02.398017 25692 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:02.398438 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:04:02.399619 25692 catalog_manager.cc:1357] Generated new cluster ID: 1b53a45836864dcfa040073a80efd6ea
I20251214 21:04:02.399681 25692 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:02.414149 25692 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:02.414752 25692 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:02.422392 25692 catalog_manager.cc:6027] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96: Generated new TSK 0
I20251214 21:04:02.422560 25692 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:02.430779 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:02.432657 25705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:02.432740 25706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:02.432888 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:02.432771 25708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:02.433085 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:02.433126 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:02.433141 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746242433141 us; error 0 us; skew 500 ppm
I20251214 21:04:02.433943 20608 webserver.cc:492] Webserver started at http://127.20.32.1:44817/ using document root <none> and password file <none>
I20251214 21:04:02.434074 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:02.434115 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:02.434167 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:02.434501 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "cfac124c414d49b8b915f57929e85979"
format_stamp: "Formatted at 2025-12-14 21:04:02 on dist-test-slave-bphs"
I20251214 21:04:02.435801 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:02.436604 25713 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.436837 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:02.436901 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "cfac124c414d49b8b915f57929e85979"
format_stamp: "Formatted at 2025-12-14 21:04:02 on dist-test-slave-bphs"
I20251214 21:04:02.436964 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:02.444759 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:02.445113 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:02.445367 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:02.445840 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:02.445880 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.445919 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:02.445945 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.449667 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:42213
I20251214 21:04:02.449726 25776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:42213 every 8 connection(s)
I20251214 21:04:02.450420 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:02.452410 25782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:02.452445 25781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:02.452674 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:02.452697 25784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:02.452862 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:02.452921 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:02.452950 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746242452949 us; error 0 us; skew 500 ppm
I20251214 21:04:02.453871 20608 webserver.cc:492] Webserver started at http://127.20.32.2:44977/ using document root <none> and password file <none>
I20251214 21:04:02.454023 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:02.454067 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:02.454136 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:02.454489 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "a1ad8f6d40474e368554d099ef1250de"
format_stamp: "Formatted at 2025-12-14 21:04:02 on dist-test-slave-bphs"
I20251214 21:04:02.455799 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:04:02.456573 25789 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.456771 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:02.456832 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "a1ad8f6d40474e368554d099ef1250de"
format_stamp: "Formatted at 2025-12-14 21:04:02 on dist-test-slave-bphs"
I20251214 21:04:02.456895 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:02.458459 25777 heartbeater.cc:344] Connected to a master server at 127.20.32.62:39905
I20251214 21:04:02.458542 25777 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:02.458745 25777 heartbeater.cc:507] Master 127.20.32.62:39905 requested a full tablet report, sending...
I20251214 21:04:02.459263 25648 ts_manager.cc:194] Registered new tserver with Master: cfac124c414d49b8b915f57929e85979 (127.20.32.1:42213)
I20251214 21:04:02.460261 25648 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60168
I20251214 21:04:02.476191 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:02.476634 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:02.476887 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:02.477326 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:02.477362 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.477393 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:02.477420 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.481863 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:43633
I20251214 21:04:02.481911 25852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:43633 every 8 connection(s)
I20251214 21:04:02.482685 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:02.484608 25859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:02.484691 25856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:02.484876 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:02.484696 25857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:02.485157 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:02.485209 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:02.485229 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746242485229 us; error 0 us; skew 500 ppm
I20251214 21:04:02.486182 20608 webserver.cc:492] Webserver started at http://127.20.32.3:42287/ using document root <none> and password file <none>
I20251214 21:04:02.486340 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:02.486389 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:02.486459 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:02.486934 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "28435a9702904e0581827e18ef067865"
format_stamp: "Formatted at 2025-12-14 21:04:02 on dist-test-slave-bphs"
I20251214 21:04:02.487407 25853 heartbeater.cc:344] Connected to a master server at 127.20.32.62:39905
I20251214 21:04:02.487488 25853 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:02.487663 25853 heartbeater.cc:507] Master 127.20.32.62:39905 requested a full tablet report, sending...
I20251214 21:04:02.488232 25648 ts_manager.cc:194] Registered new tserver with Master: a1ad8f6d40474e368554d099ef1250de (127.20.32.2:43633)
I20251214 21:04:02.488490 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:02.488775 25648 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60182
I20251214 21:04:02.489387 25864 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.489604 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:02.489665 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "28435a9702904e0581827e18ef067865"
format_stamp: "Formatted at 2025-12-14 21:04:02 on dist-test-slave-bphs"
I20251214 21:04:02.489768 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:02.513684 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:02.514118 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:02.514411 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:02.514874 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:02.514912 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.514952 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:02.514981 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:02.519279 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:45983
I20251214 21:04:02.519333 25927 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:45983 every 8 connection(s)
I20251214 21:04:02.523624 25928 heartbeater.cc:344] Connected to a master server at 127.20.32.62:39905
I20251214 21:04:02.523743 25928 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:02.523969 25928 heartbeater.cc:507] Master 127.20.32.62:39905 requested a full tablet report, sending...
I20251214 21:04:02.524537 25648 ts_manager.cc:194] Registered new tserver with Master: 28435a9702904e0581827e18ef067865 (127.20.32.3:45983)
I20251214 21:04:02.525050 25648 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60192
I20251214 21:04:02.525312 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005647931s
I20251214 21:04:03.461062 25777 heartbeater.cc:499] Master 127.20.32.62:39905 was elected leader, sending a full tablet report...
I20251214 21:04:03.489634 25853 heartbeater.cc:499] Master 127.20.32.62:39905 was elected leader, sending a full tablet report...
I20251214 21:04:03.525977 25928 heartbeater.cc:499] Master 127.20.32.62:39905 was elected leader, sending a full tablet report...
I20251214 21:04:03.551929 20608 test_util.cc:276] Using random seed: -711179595
I20251214 21:04:03.560199 25648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60196:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:04:03.560672 25648 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:04:03.570186 25892 tablet_service.cc:1505] Processing CreateTablet for tablet b804df3dbbcc486e83042c7ae578282f (DEFAULT_TABLE table=test-workload [id=eb36a15705a447e2b562ffa7c69f944e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:03.570328 25817 tablet_service.cc:1505] Processing CreateTablet for tablet b804df3dbbcc486e83042c7ae578282f (DEFAULT_TABLE table=test-workload [id=eb36a15705a447e2b562ffa7c69f944e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:03.570417 25741 tablet_service.cc:1505] Processing CreateTablet for tablet b804df3dbbcc486e83042c7ae578282f (DEFAULT_TABLE table=test-workload [id=eb36a15705a447e2b562ffa7c69f944e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:03.570518 25892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b804df3dbbcc486e83042c7ae578282f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:03.570603 25817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b804df3dbbcc486e83042c7ae578282f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:03.570603 25741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b804df3dbbcc486e83042c7ae578282f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:03.572640 25948 tablet_bootstrap.cc:492] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865: Bootstrap starting.
I20251214 21:04:03.572909 25949 tablet_bootstrap.cc:492] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de: Bootstrap starting.
I20251214 21:04:03.573908 25950 tablet_bootstrap.cc:492] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979: Bootstrap starting.
I20251214 21:04:03.573951 25949 tablet_bootstrap.cc:654] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:03.573951 25948 tablet_bootstrap.cc:654] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:03.574800 25950 tablet_bootstrap.cc:654] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:03.575387 25948 tablet_bootstrap.cc:492] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865: No bootstrap required, opened a new log
I20251214 21:04:03.575479 25948 ts_tablet_manager.cc:1403] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:03.575557 25949 tablet_bootstrap.cc:492] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de: No bootstrap required, opened a new log
I20251214 21:04:03.575645 25949 ts_tablet_manager.cc:1403] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:03.575781 25950 tablet_bootstrap.cc:492] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979: No bootstrap required, opened a new log
I20251214 21:04:03.575860 25950 ts_tablet_manager.cc:1403] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:03.575929 25948 raft_consensus.cc:359] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.576071 25948 raft_consensus.cc:385] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:03.576117 25948 raft_consensus.cc:740] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28435a9702904e0581827e18ef067865, State: Initialized, Role: FOLLOWER
I20251214 21:04:03.576089 25949 raft_consensus.cc:359] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.576217 25949 raft_consensus.cc:385] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:03.576258 25949 raft_consensus.cc:740] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ad8f6d40474e368554d099ef1250de, State: Initialized, Role: FOLLOWER
I20251214 21:04:03.576241 25948 consensus_queue.cc:260] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.576318 25950 raft_consensus.cc:359] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.576375 25949 consensus_queue.cc:260] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.576442 25950 raft_consensus.cc:385] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:03.576500 25950 raft_consensus.cc:740] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfac124c414d49b8b915f57929e85979, State: Initialized, Role: FOLLOWER
I20251214 21:04:03.576615 25948 ts_tablet_manager.cc:1434] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:03.576617 25950 consensus_queue.cc:260] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.576697 25949 ts_tablet_manager.cc:1434] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:03.576930 25950 ts_tablet_manager.cc:1434] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:03.620698 25955 raft_consensus.cc:493] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:03.620854 25955 raft_consensus.cc:515] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.621421 25955 leader_election.cc:290] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28435a9702904e0581827e18ef067865 (127.20.32.3:45983), cfac124c414d49b8b915f57929e85979 (127.20.32.1:42213)
I20251214 21:04:03.624778 25751 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b804df3dbbcc486e83042c7ae578282f" candidate_uuid: "a1ad8f6d40474e368554d099ef1250de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfac124c414d49b8b915f57929e85979" is_pre_election: true
I20251214 21:04:03.624787 25902 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b804df3dbbcc486e83042c7ae578282f" candidate_uuid: "a1ad8f6d40474e368554d099ef1250de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28435a9702904e0581827e18ef067865" is_pre_election: true
I20251214 21:04:03.624936 25751 raft_consensus.cc:2468] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ad8f6d40474e368554d099ef1250de in term 0.
I20251214 21:04:03.624935 25902 raft_consensus.cc:2468] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ad8f6d40474e368554d099ef1250de in term 0.
I20251214 21:04:03.625243 25792 leader_election.cc:304] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28435a9702904e0581827e18ef067865, a1ad8f6d40474e368554d099ef1250de; no voters:
I20251214 21:04:03.625407 25955 raft_consensus.cc:2804] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:03.625468 25955 raft_consensus.cc:493] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:03.625517 25955 raft_consensus.cc:3060] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:03.626387 25955 raft_consensus.cc:515] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.626750 25955 leader_election.cc:290] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [CANDIDATE]: Term 1 election: Requested vote from peers 28435a9702904e0581827e18ef067865 (127.20.32.3:45983), cfac124c414d49b8b915f57929e85979 (127.20.32.1:42213)
I20251214 21:04:03.627074 25902 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b804df3dbbcc486e83042c7ae578282f" candidate_uuid: "a1ad8f6d40474e368554d099ef1250de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28435a9702904e0581827e18ef067865"
I20251214 21:04:03.627075 25751 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b804df3dbbcc486e83042c7ae578282f" candidate_uuid: "a1ad8f6d40474e368554d099ef1250de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfac124c414d49b8b915f57929e85979"
I20251214 21:04:03.627188 25902 raft_consensus.cc:3060] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:03.627216 25751 raft_consensus.cc:3060] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:03.628189 25751 raft_consensus.cc:2468] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ad8f6d40474e368554d099ef1250de in term 1.
I20251214 21:04:03.628202 25902 raft_consensus.cc:2468] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ad8f6d40474e368554d099ef1250de in term 1.
I20251214 21:04:03.628463 25791 leader_election.cc:304] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ad8f6d40474e368554d099ef1250de, cfac124c414d49b8b915f57929e85979; no voters:
I20251214 21:04:03.628796 25955 raft_consensus.cc:2804] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:03.629009 25955 raft_consensus.cc:697] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 1 LEADER]: Becoming Leader. State: Replica: a1ad8f6d40474e368554d099ef1250de, State: Running, Role: LEADER
I20251214 21:04:03.629148 25955 consensus_queue.cc:237] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } }
I20251214 21:04:03.630546 25648 catalog_manager.cc:5654] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de reported cstate change: term changed from 0 to 1, leader changed from <none> to a1ad8f6d40474e368554d099ef1250de (127.20.32.2). New cstate: current_term: 1 leader_uuid: "a1ad8f6d40474e368554d099ef1250de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfac124c414d49b8b915f57929e85979" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 42213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ad8f6d40474e368554d099ef1250de" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 43633 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:03.644047 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:04:03.647224 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:03.647511 20608 tablet_replica.cc:333] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979: stopping tablet replica
I20251214 21:04:03.647616 20608 raft_consensus.cc:2243] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:03.647742 20608 raft_consensus.cc:2272] T b804df3dbbcc486e83042c7ae578282f P cfac124c414d49b8b915f57929e85979 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:03.660707 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:04:04.077600 25955 consensus_queue.cc:1048] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [LEADER]: Connected to new peer: Peer: permanent_uuid: "28435a9702904e0581827e18ef067865" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:04:04.080241 25791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.32.1:42213: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20251214 21:04:04.081310 25791 consensus_peers.cc:597] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de -> Peer cfac124c414d49b8b915f57929e85979 (127.20.32.1:42213): Couldn't send request to peer cfac124c414d49b8b915f57929e85979. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:42213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:04.398511 25702 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:04:04.398808 25702 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:04:04.398881 25702 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:04:06.399197 25702 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:04:06.399479 25702 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:04:06.399528 25702 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251214 21:04:06.630741 25791 consensus_peers.cc:597] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de -> Peer cfac124c414d49b8b915f57929e85979 (127.20.32.1:42213): Couldn't send request to peer cfac124c414d49b8b915f57929e85979. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:42213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251214 21:04:08.399843 25702 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:04:08.400204 25702 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:04:08.400274 25702 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251214 21:04:09.364182 25791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.32.1:42213: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20251214 21:04:09.364931 25791 consensus_peers.cc:597] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de -> Peer cfac124c414d49b8b915f57929e85979 (127.20.32.1:42213): Couldn't send request to peer cfac124c414d49b8b915f57929e85979. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:42213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20251214 21:04:10.400575 25702 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:04:10.400874 25702 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:04:10.400924 25702 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251214 21:04:11.923252 25791 consensus_peers.cc:597] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de -> Peer cfac124c414d49b8b915f57929e85979 (127.20.32.1:42213): Couldn't send request to peer cfac124c414d49b8b915f57929e85979. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:42213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20251214 21:04:12.401206 25702 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:04:12.401500 25702 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:04:12.401548 25702 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20251214 21:04:14.401940 25702 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20251214 21:04:14.402245 25702 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20251214 21:04:14.402300 25702 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20251214 21:04:14.684821 25791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.32.1:42213: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20251214 21:04:14.685583 25791 consensus_peers.cc:597] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de -> Peer cfac124c414d49b8b915f57929e85979 (127.20.32.1:42213): Couldn't send request to peer cfac124c414d49b8b915f57929e85979. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:42213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20251214 21:04:14.714766 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:04:14.718060 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:14.718250 20608 tablet_replica.cc:333] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de: stopping tablet replica
I20251214 21:04:14.718357 20608 raft_consensus.cc:2243] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:14.718566 20608 raft_consensus.cc:2272] T b804df3dbbcc486e83042c7ae578282f P a1ad8f6d40474e368554d099ef1250de [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:14.731230 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:04:14.733340 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:04:14.736955 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:14.737147 20608 tablet_replica.cc:333] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865: stopping tablet replica
I20251214 21:04:14.737241 20608 raft_consensus.cc:2243] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:14.737339 20608 raft_consensus.cc:2272] T b804df3dbbcc486e83042c7ae578282f P 28435a9702904e0581827e18ef067865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:14.749845 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:04:14.751787 20608 master.cc:561] Master@127.20.32.62:39905 shutting down...
I20251214 21:04:14.754585 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:14.754731 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:14.754781 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P db91cb2e84624516854f39ec22759d96: stopping tablet replica
I20251214 21:04:14.767077 20608 master.cc:583] Master@127.20.32.62:39905 shutdown complete.
[ OK ] AutoRebalancerTest.NoReplicaMovesIfCannotMeetReplicationFactor (12403 ms)
[ RUN ] AutoRebalancerTest.NoRebalancingIfReplicasRecovering
I20251214 21:04:14.772904 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:44069
I20251214 21:04:14.773217 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:14.774991 25993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:14.775063 25996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:14.775205 25994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:14.775101 20608 server_base.cc:1047] running on GCE node
I20251214 21:04:14.775359 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:14.775400 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:14.775420 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746254775419 us; error 0 us; skew 500 ppm
I20251214 21:04:14.776149 20608 webserver.cc:492] Webserver started at http://127.20.32.62:45811/ using document root <none> and password file <none>
I20251214 21:04:14.776274 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:14.776319 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:14.776391 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:14.776737 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "11b636413d5c495bb34a0153e023af05"
format_stamp: "Formatted at 2025-12-14 21:04:14 on dist-test-slave-bphs"
I20251214 21:04:14.778116 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:14.778985 26001 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.779271 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:14.779335 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "11b636413d5c495bb34a0153e023af05"
format_stamp: "Formatted at 2025-12-14 21:04:14 on dist-test-slave-bphs"
I20251214 21:04:14.779390 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:14.811445 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:14.811802 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:14.815593 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:44069
I20251214 21:04:14.817808 26053 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:44069 every 8 connection(s)
I20251214 21:04:14.818234 26054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:14.820031 26054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05: Bootstrap starting.
I20251214 21:04:14.820767 26054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:14.821691 26054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05: No bootstrap required, opened a new log
I20251214 21:04:14.822103 26054 raft_consensus.cc:359] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b636413d5c495bb34a0153e023af05" member_type: VOTER }
I20251214 21:04:14.822188 26054 raft_consensus.cc:385] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:14.822217 26054 raft_consensus.cc:740] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b636413d5c495bb34a0153e023af05, State: Initialized, Role: FOLLOWER
I20251214 21:04:14.822327 26054 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b636413d5c495bb34a0153e023af05" member_type: VOTER }
I20251214 21:04:14.822391 26054 raft_consensus.cc:399] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:14.822420 26054 raft_consensus.cc:493] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:14.822466 26054 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:14.823125 26054 raft_consensus.cc:515] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b636413d5c495bb34a0153e023af05" member_type: VOTER }
I20251214 21:04:14.823237 26054 leader_election.cc:304] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11b636413d5c495bb34a0153e023af05; no voters:
I20251214 21:04:14.823400 26054 leader_election.cc:290] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:14.823498 26057 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:14.823690 26057 raft_consensus.cc:697] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 1 LEADER]: Becoming Leader. State: Replica: 11b636413d5c495bb34a0153e023af05, State: Running, Role: LEADER
I20251214 21:04:14.823788 26054 sys_catalog.cc:565] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:14.823808 26057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b636413d5c495bb34a0153e023af05" member_type: VOTER }
I20251214 21:04:14.824239 26058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11b636413d5c495bb34a0153e023af05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b636413d5c495bb34a0153e023af05" member_type: VOTER } }
I20251214 21:04:14.824282 26059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11b636413d5c495bb34a0153e023af05. Latest consensus state: current_term: 1 leader_uuid: "11b636413d5c495bb34a0153e023af05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b636413d5c495bb34a0153e023af05" member_type: VOTER } }
I20251214 21:04:14.824324 26058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:14.824368 26059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:14.824781 26063 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:14.825662 26063 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:14.825886 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:04:14.827553 26063 catalog_manager.cc:1357] Generated new cluster ID: 970ac24504a74a37b8f092a17e02b89f
I20251214 21:04:14.827610 26063 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:14.843896 26063 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:14.844434 26063 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:14.851589 26063 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05: Generated new TSK 0
I20251214 21:04:14.851754 26063 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:14.858274 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:14.860095 26076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:14.860142 26078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:14.860270 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:14.860119 26075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:14.860450 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:14.860486 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:14.860505 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746254860505 us; error 0 us; skew 500 ppm
I20251214 21:04:14.861275 20608 webserver.cc:492] Webserver started at http://127.20.32.1:33381/ using document root <none> and password file <none>
I20251214 21:04:14.861411 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:14.861457 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:14.861526 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:14.861932 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b"
format_stamp: "Formatted at 2025-12-14 21:04:14 on dist-test-slave-bphs"
I20251214 21:04:14.863353 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:14.864228 26083 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.864491 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:14.864552 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b"
format_stamp: "Formatted at 2025-12-14 21:04:14 on dist-test-slave-bphs"
I20251214 21:04:14.864606 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:14.878799 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:14.879179 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:14.879420 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:14.879854 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:14.879891 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.879922 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:14.879949 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.883774 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:33213
I20251214 21:04:14.883823 26146 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:33213 every 8 connection(s)
I20251214 21:04:14.884542 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:14.886260 26151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:14.886274 26152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:14.886394 26154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:14.886509 20608 server_base.cc:1047] running on GCE node
I20251214 21:04:14.886723 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:14.886770 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:14.886785 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746254886785 us; error 0 us; skew 500 ppm
I20251214 21:04:14.887643 20608 webserver.cc:492] Webserver started at http://127.20.32.2:43429/ using document root <none> and password file <none>
I20251214 21:04:14.887797 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:14.887858 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:14.887931 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:14.888371 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "d9bfc501ef2f421f82838b76e8badd81"
format_stamp: "Formatted at 2025-12-14 21:04:14 on dist-test-slave-bphs"
I20251214 21:04:14.888788 26147 heartbeater.cc:344] Connected to a master server at 127.20.32.62:44069
I20251214 21:04:14.888887 26147 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:14.889073 26147 heartbeater.cc:507] Master 127.20.32.62:44069 requested a full tablet report, sending...
I20251214 21:04:14.889590 26018 ts_manager.cc:194] Registered new tserver with Master: 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213)
I20251214 21:04:14.889976 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:14.890403 26018 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45010
I20251214 21:04:14.890863 26159 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.891096 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:14.891153 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "d9bfc501ef2f421f82838b76e8badd81"
format_stamp: "Formatted at 2025-12-14 21:04:14 on dist-test-slave-bphs"
I20251214 21:04:14.891211 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:14.907660 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:14.908063 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:14.908337 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:14.908777 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:14.908816 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.908864 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:14.908891 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.913210 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:45013
I20251214 21:04:14.913264 26222 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:45013 every 8 connection(s)
I20251214 21:04:14.914021 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:14.915758 26227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:14.915777 26229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:14.915781 26226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:14.916061 20608 server_base.cc:1047] running on GCE node
I20251214 21:04:14.916235 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:14.916275 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:14.916290 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746254916290 us; error 0 us; skew 500 ppm
I20251214 21:04:14.917258 20608 webserver.cc:492] Webserver started at http://127.20.32.3:44587/ using document root <none> and password file <none>
I20251214 21:04:14.917412 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:14.917472 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:14.917546 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:14.917865 26223 heartbeater.cc:344] Connected to a master server at 127.20.32.62:44069
I20251214 21:04:14.917969 26223 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:14.917968 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "c1daaa5b29b2488c93b321af7c24f0c4"
format_stamp: "Formatted at 2025-12-14 21:04:14 on dist-test-slave-bphs"
I20251214 21:04:14.918208 26223 heartbeater.cc:507] Master 127.20.32.62:44069 requested a full tablet report, sending...
I20251214 21:04:14.918761 26018 ts_manager.cc:194] Registered new tserver with Master: d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013)
I20251214 21:04:14.919266 26018 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45024
I20251214 21:04:14.919503 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:14.920387 26234 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.920660 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:14.920725 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "c1daaa5b29b2488c93b321af7c24f0c4"
format_stamp: "Formatted at 2025-12-14 21:04:14 on dist-test-slave-bphs"
I20251214 21:04:14.920789 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:14.934075 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:14.934492 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:14.934784 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:14.935218 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:14.935256 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.935295 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:14.935322 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:14.939514 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:39235
I20251214 21:04:14.939581 26297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:39235 every 8 connection(s)
I20251214 21:04:14.943540 26298 heartbeater.cc:344] Connected to a master server at 127.20.32.62:44069
I20251214 21:04:14.943645 26298 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:14.943861 26298 heartbeater.cc:507] Master 127.20.32.62:44069 requested a full tablet report, sending...
I20251214 21:04:14.944406 26018 ts_manager.cc:194] Registered new tserver with Master: c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:14.944916 26018 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45026
I20251214 21:04:14.945451 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005545463s
I20251214 21:04:15.891319 26147 heartbeater.cc:499] Master 127.20.32.62:44069 was elected leader, sending a full tablet report...
I20251214 21:04:15.920090 26223 heartbeater.cc:499] Master 127.20.32.62:44069 was elected leader, sending a full tablet report...
I20251214 21:04:15.945786 26298 heartbeater.cc:499] Master 127.20.32.62:44069 was elected leader, sending a full tablet report...
I20251214 21:04:15.971577 20608 test_util.cc:276] Using random seed: -698759947
I20251214 21:04:15.980970 26018 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45040:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:04:15.981523 26018 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:04:15.993333 26186 tablet_service.cc:1505] Processing CreateTablet for tablet 6a95d1b5b1d3444386611c94afaa30f9 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:15.993269 26187 tablet_service.cc:1505] Processing CreateTablet for tablet 791a25a30cb7404f9b176b9c45c5aaa8 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:15.993410 26262 tablet_service.cc:1505] Processing CreateTablet for tablet 791a25a30cb7404f9b176b9c45c5aaa8 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:15.993656 26186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a95d1b5b1d3444386611c94afaa30f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:15.993685 26262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791a25a30cb7404f9b176b9c45c5aaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:15.993973 26185 tablet_service.cc:1505] Processing CreateTablet for tablet e79049cc2a004270a81cfc80a653c599 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:15.994386 26184 tablet_service.cc:1505] Processing CreateTablet for tablet 102ad02708ab45e4b9c4eb531cfbc6f5 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:15.994788 26184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102ad02708ab45e4b9c4eb531cfbc6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:15.994964 26185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79049cc2a004270a81cfc80a653c599. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:15.996361 26111 tablet_service.cc:1505] Processing CreateTablet for tablet 791a25a30cb7404f9b176b9c45c5aaa8 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:15.996595 26111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791a25a30cb7404f9b176b9c45c5aaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:15.996908 26187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791a25a30cb7404f9b176b9c45c5aaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:15.997895 26108 tablet_service.cc:1505] Processing CreateTablet for tablet 102ad02708ab45e4b9c4eb531cfbc6f5 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:15.998030 26319 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81: Bootstrap starting.
I20251214 21:04:15.998127 26108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102ad02708ab45e4b9c4eb531cfbc6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:15.998935 26320 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Bootstrap starting.
I20251214 21:04:15.999073 26319 tablet_bootstrap.cc:654] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:15.999838 26320 tablet_bootstrap.cc:654] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:15.999959 26259 tablet_service.cc:1505] Processing CreateTablet for tablet 102ad02708ab45e4b9c4eb531cfbc6f5 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:16.000154 26259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102ad02708ab45e4b9c4eb531cfbc6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:16.000319 26319 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81: No bootstrap required, opened a new log
I20251214 21:04:16.000394 26319 ts_tablet_manager.cc:1403] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:16.000787 26319 raft_consensus.cc:359] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.000885 26319 raft_consensus.cc:385] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.000888 26320 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: No bootstrap required, opened a new log
I20251214 21:04:16.000969 26319 raft_consensus.cc:740] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9bfc501ef2f421f82838b76e8badd81, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.001045 26320 ts_tablet_manager.cc:1403] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:16.001092 26319 consensus_queue.cc:260] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.001443 26320 raft_consensus.cc:359] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.001524 26320 raft_consensus.cc:385] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.001555 26320 raft_consensus.cc:740] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8d6f43759d4d8baeb5fd0112ef1e5b, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.001688 26320 consensus_queue.cc:260] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.001816 26319 ts_tablet_manager.cc:1434] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:16.001953 26109 tablet_service.cc:1505] Processing CreateTablet for tablet e79049cc2a004270a81cfc80a653c599 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:16.002020 26320 ts_tablet_manager.cc:1434] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:16.002192 26320 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Bootstrap starting.
I20251214 21:04:16.002274 26260 tablet_service.cc:1505] Processing CreateTablet for tablet e79049cc2a004270a81cfc80a653c599 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:16.002440 26319 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81: Bootstrap starting.
I20251214 21:04:16.002519 26260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79049cc2a004270a81cfc80a653c599. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:16.003935 26320 tablet_bootstrap.cc:654] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.004299 26319 tablet_bootstrap.cc:654] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.004552 26261 tablet_service.cc:1505] Processing CreateTablet for tablet 6a95d1b5b1d3444386611c94afaa30f9 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:16.004761 26261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a95d1b5b1d3444386611c94afaa30f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:16.005487 26320 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: No bootstrap required, opened a new log
I20251214 21:04:16.005553 26320 ts_tablet_manager.cc:1403] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251214 21:04:16.005966 26320 raft_consensus.cc:359] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.006064 26320 raft_consensus.cc:385] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.006098 26320 raft_consensus.cc:740] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8d6f43759d4d8baeb5fd0112ef1e5b, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.006212 26320 consensus_queue.cc:260] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.006441 26320 ts_tablet_manager.cc:1434] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:16.006855 26319 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81: No bootstrap required, opened a new log
I20251214 21:04:16.006932 26319 ts_tablet_manager.cc:1403] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251214 21:04:16.007074 26110 tablet_service.cc:1505] Processing CreateTablet for tablet 6a95d1b5b1d3444386611c94afaa30f9 (DEFAULT_TABLE table=test-workload [id=7279a824a94243aea66c762164b9d614]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:16.007308 26319 raft_consensus.cc:359] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.007406 26319 raft_consensus.cc:385] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.007436 26319 raft_consensus.cc:740] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9bfc501ef2f421f82838b76e8badd81, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.007540 26319 consensus_queue.cc:260] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.007786 26319 ts_tablet_manager.cc:1434] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:16.007975 26319 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81: Bootstrap starting.
I20251214 21:04:16.008152 26110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a95d1b5b1d3444386611c94afaa30f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:16.008882 26319 tablet_bootstrap.cc:654] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.009779 26320 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Bootstrap starting.
I20251214 21:04:16.009835 26109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79049cc2a004270a81cfc80a653c599. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:16.009933 26319 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81: No bootstrap required, opened a new log
I20251214 21:04:16.010017 26319 ts_tablet_manager.cc:1403] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:16.010443 26319 raft_consensus.cc:359] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.010553 26319 raft_consensus.cc:385] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.010594 26319 raft_consensus.cc:740] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9bfc501ef2f421f82838b76e8badd81, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.010692 26319 consensus_queue.cc:260] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.011271 26319 ts_tablet_manager.cc:1434] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:16.011436 26319 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81: Bootstrap starting.
I20251214 21:04:16.011615 26320 tablet_bootstrap.cc:654] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.012492 26319 tablet_bootstrap.cc:654] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.012643 26318 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4: Bootstrap starting.
I20251214 21:04:16.013585 26319 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81: No bootstrap required, opened a new log
I20251214 21:04:16.013680 26319 ts_tablet_manager.cc:1403] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:16.013823 26318 tablet_bootstrap.cc:654] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.014163 26319 raft_consensus.cc:359] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.014276 26319 raft_consensus.cc:385] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.014318 26319 raft_consensus.cc:740] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9bfc501ef2f421f82838b76e8badd81, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.014438 26319 consensus_queue.cc:260] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.014659 26320 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: No bootstrap required, opened a new log
I20251214 21:04:16.014724 26318 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4: No bootstrap required, opened a new log
I20251214 21:04:16.014739 26320 ts_tablet_manager.cc:1403] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251214 21:04:16.014771 26319 ts_tablet_manager.cc:1434] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:16.014778 26318 ts_tablet_manager.cc:1403] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251214 21:04:16.015162 26318 raft_consensus.cc:359] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.015153 26320 raft_consensus.cc:359] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.015286 26320 raft_consensus.cc:385] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.015277 26318 raft_consensus.cc:385] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.015350 26320 raft_consensus.cc:740] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8d6f43759d4d8baeb5fd0112ef1e5b, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.015357 26318 raft_consensus.cc:740] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1daaa5b29b2488c93b321af7c24f0c4, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.015563 26318 consensus_queue.cc:260] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.015547 26320 consensus_queue.cc:260] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.015877 26320 ts_tablet_manager.cc:1434] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:16.015939 26318 ts_tablet_manager.cc:1434] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:16.016044 26320 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Bootstrap starting.
I20251214 21:04:16.016384 26318 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4: Bootstrap starting.
I20251214 21:04:16.017004 26320 tablet_bootstrap.cc:654] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.017263 26318 tablet_bootstrap.cc:654] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.018244 26320 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: No bootstrap required, opened a new log
I20251214 21:04:16.018299 26318 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4: No bootstrap required, opened a new log
I20251214 21:04:16.018328 26320 ts_tablet_manager.cc:1403] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251214 21:04:16.018381 26318 ts_tablet_manager.cc:1403] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251214 21:04:16.018949 26320 raft_consensus.cc:359] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.019091 26320 raft_consensus.cc:385] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.019130 26320 raft_consensus.cc:740] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8d6f43759d4d8baeb5fd0112ef1e5b, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.018949 26318 raft_consensus.cc:359] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.019238 26318 raft_consensus.cc:385] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.019300 26318 raft_consensus.cc:740] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1daaa5b29b2488c93b321af7c24f0c4, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.019250 26320 consensus_queue.cc:260] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.019421 26318 consensus_queue.cc:260] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.019526 26320 ts_tablet_manager.cc:1434] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:16.019667 26318 ts_tablet_manager.cc:1434] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:16.019846 26318 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4: Bootstrap starting.
I20251214 21:04:16.020828 26318 tablet_bootstrap.cc:654] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.021946 26318 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4: No bootstrap required, opened a new log
I20251214 21:04:16.022027 26318 ts_tablet_manager.cc:1403] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251214 21:04:16.022368 26318 raft_consensus.cc:359] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.022457 26318 raft_consensus.cc:385] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.022487 26318 raft_consensus.cc:740] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1daaa5b29b2488c93b321af7c24f0c4, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.022595 26318 consensus_queue.cc:260] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.022819 26318 ts_tablet_manager.cc:1434] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:16.022995 26318 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4: Bootstrap starting.
I20251214 21:04:16.023983 26318 tablet_bootstrap.cc:654] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:16.025107 26318 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4: No bootstrap required, opened a new log
I20251214 21:04:16.025187 26318 ts_tablet_manager.cc:1403] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251214 21:04:16.025532 26318 raft_consensus.cc:359] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.025621 26318 raft_consensus.cc:385] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:16.025650 26318 raft_consensus.cc:740] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1daaa5b29b2488c93b321af7c24f0c4, State: Initialized, Role: FOLLOWER
I20251214 21:04:16.025789 26318 consensus_queue.cc:260] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.026067 26318 ts_tablet_manager.cc:1434] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:16.090781 26323 raft_consensus.cc:493] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:16.090948 26323 raft_consensus.cc:515] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.091507 26323 leader_election.cc:290] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235), 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213)
I20251214 21:04:16.095059 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791a25a30cb7404f9b176b9c45c5aaa8" candidate_uuid: "d9bfc501ef2f421f82838b76e8badd81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" is_pre_election: true
I20251214 21:04:16.095060 26121 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791a25a30cb7404f9b176b9c45c5aaa8" candidate_uuid: "d9bfc501ef2f421f82838b76e8badd81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" is_pre_election: true
I20251214 21:04:16.095230 26272 raft_consensus.cc:2468] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9bfc501ef2f421f82838b76e8badd81 in term 0.
I20251214 21:04:16.095247 26121 raft_consensus.cc:2468] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9bfc501ef2f421f82838b76e8badd81 in term 0.
I20251214 21:04:16.095515 26161 leader_election.cc:304] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b, d9bfc501ef2f421f82838b76e8badd81; no voters:
I20251214 21:04:16.095695 26323 raft_consensus.cc:2804] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:16.095749 26323 raft_consensus.cc:493] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:16.095775 26323 raft_consensus.cc:3060] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.096638 26323 raft_consensus.cc:515] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.096976 26323 leader_election.cc:290] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 1 election: Requested vote from peers c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235), 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213)
I20251214 21:04:16.097306 26121 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791a25a30cb7404f9b176b9c45c5aaa8" candidate_uuid: "d9bfc501ef2f421f82838b76e8badd81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b"
I20251214 21:04:16.097306 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "791a25a30cb7404f9b176b9c45c5aaa8" candidate_uuid: "d9bfc501ef2f421f82838b76e8badd81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4"
I20251214 21:04:16.097438 26121 raft_consensus.cc:3060] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.097438 26272 raft_consensus.cc:3060] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.098428 26272 raft_consensus.cc:2468] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9bfc501ef2f421f82838b76e8badd81 in term 1.
I20251214 21:04:16.098428 26121 raft_consensus.cc:2468] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9bfc501ef2f421f82838b76e8badd81 in term 1.
I20251214 21:04:16.098717 26160 leader_election.cc:304] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters:
I20251214 21:04:16.098853 26323 raft_consensus.cc:2804] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:16.099031 26323 raft_consensus.cc:697] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 1 LEADER]: Becoming Leader. State: Replica: d9bfc501ef2f421f82838b76e8badd81, State: Running, Role: LEADER
I20251214 21:04:16.099159 26323 consensus_queue.cc:237] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } }
I20251214 21:04:16.100690 26018 catalog_manager.cc:5654] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2). New cstate: current_term: 1 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:16.104988 26324 raft_consensus.cc:493] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:16.105101 26324 raft_consensus.cc:515] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.105553 26324 leader_election.cc:290] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:16.108716 26197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a95d1b5b1d3444386611c94afaa30f9" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9bfc501ef2f421f82838b76e8badd81" is_pre_election: true
I20251214 21:04:16.108860 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a95d1b5b1d3444386611c94afaa30f9" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" is_pre_election: true
I20251214 21:04:16.108877 26197 raft_consensus.cc:2468] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 0.
I20251214 21:04:16.109002 26272 raft_consensus.cc:2468] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 0.
I20251214 21:04:16.109210 26085 leader_election.cc:304] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b, d9bfc501ef2f421f82838b76e8badd81; no voters:
I20251214 21:04:16.109360 26324 raft_consensus.cc:2804] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:16.109417 26324 raft_consensus.cc:493] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:16.109462 26324 raft_consensus.cc:3060] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.110335 26324 raft_consensus.cc:515] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.110657 26324 leader_election.cc:290] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 election: Requested vote from peers d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:16.110934 26197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a95d1b5b1d3444386611c94afaa30f9" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9bfc501ef2f421f82838b76e8badd81"
I20251214 21:04:16.110934 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a95d1b5b1d3444386611c94afaa30f9" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4"
I20251214 21:04:16.111061 26197 raft_consensus.cc:3060] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.111061 26272 raft_consensus.cc:3060] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.111966 26272 raft_consensus.cc:2468] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 1.
I20251214 21:04:16.111966 26197 raft_consensus.cc:2468] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 1.
I20251214 21:04:16.112289 26084 leader_election.cc:304] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b, c1daaa5b29b2488c93b321af7c24f0c4; no voters:
I20251214 21:04:16.112475 26324 raft_consensus.cc:2804] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:16.112653 26324 raft_consensus.cc:697] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: Becoming Leader. State: Replica: 5c8d6f43759d4d8baeb5fd0112ef1e5b, State: Running, Role: LEADER
I20251214 21:04:16.112774 26324 consensus_queue.cc:237] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.114228 26018 catalog_manager.cc:5654] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1). New cstate: current_term: 1 leader_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:16.159524 26324 raft_consensus.cc:493] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:16.159698 26324 raft_consensus.cc:515] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.160128 26324 leader_election.cc:290] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:16.160632 26197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79049cc2a004270a81cfc80a653c599" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9bfc501ef2f421f82838b76e8badd81" is_pre_election: true
I20251214 21:04:16.160632 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79049cc2a004270a81cfc80a653c599" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" is_pre_election: true
I20251214 21:04:16.160794 26272 raft_consensus.cc:2468] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 0.
I20251214 21:04:16.160794 26197 raft_consensus.cc:2468] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 0.
I20251214 21:04:16.161088 26085 leader_election.cc:304] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b, c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters:
I20251214 21:04:16.161278 26324 raft_consensus.cc:2804] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:16.161341 26324 raft_consensus.cc:493] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:16.161386 26324 raft_consensus.cc:3060] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.162278 26324 raft_consensus.cc:515] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.162580 26324 leader_election.cc:290] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 election: Requested vote from peers d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:16.162856 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79049cc2a004270a81cfc80a653c599" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4"
I20251214 21:04:16.162860 26197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79049cc2a004270a81cfc80a653c599" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9bfc501ef2f421f82838b76e8badd81"
I20251214 21:04:16.162947 26272 raft_consensus.cc:3060] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.162987 26197 raft_consensus.cc:3060] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.163682 26272 raft_consensus.cc:2468] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 1.
I20251214 21:04:16.163769 26197 raft_consensus.cc:2468] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 1.
I20251214 21:04:16.163959 26084 leader_election.cc:304] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b, c1daaa5b29b2488c93b321af7c24f0c4; no voters:
I20251214 21:04:16.164188 26324 raft_consensus.cc:2804] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:16.164270 26324 raft_consensus.cc:697] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: Becoming Leader. State: Replica: 5c8d6f43759d4d8baeb5fd0112ef1e5b, State: Running, Role: LEADER
I20251214 21:04:16.164392 26324 consensus_queue.cc:237] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.165962 26018 catalog_manager.cc:5654] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1). New cstate: current_term: 1 leader_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:16.192150 26324 raft_consensus.cc:493] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:16.192303 26324 raft_consensus.cc:515] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.192924 26324 leader_election.cc:290] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:16.193341 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "102ad02708ab45e4b9c4eb531cfbc6f5" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" is_pre_election: true
I20251214 21:04:16.193341 26197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "102ad02708ab45e4b9c4eb531cfbc6f5" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9bfc501ef2f421f82838b76e8badd81" is_pre_election: true
I20251214 21:04:16.193509 26197 raft_consensus.cc:2468] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 0.
I20251214 21:04:16.193509 26272 raft_consensus.cc:2468] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 0.
I20251214 21:04:16.193835 26084 leader_election.cc:304] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b, c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters:
I20251214 21:04:16.194026 26324 raft_consensus.cc:2804] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:16.194090 26324 raft_consensus.cc:493] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:16.194133 26324 raft_consensus.cc:3060] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.194978 26324 raft_consensus.cc:515] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.195288 26324 leader_election.cc:290] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 election: Requested vote from peers d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:16.195585 26197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "102ad02708ab45e4b9c4eb531cfbc6f5" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9bfc501ef2f421f82838b76e8badd81"
I20251214 21:04:16.195585 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "102ad02708ab45e4b9c4eb531cfbc6f5" candidate_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4"
I20251214 21:04:16.195741 26272 raft_consensus.cc:3060] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.195741 26197 raft_consensus.cc:3060] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:16.196635 26197 raft_consensus.cc:2468] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 1.
I20251214 21:04:16.196635 26272 raft_consensus.cc:2468] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8d6f43759d4d8baeb5fd0112ef1e5b in term 1.
I20251214 21:04:16.196905 26085 leader_election.cc:304] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b, d9bfc501ef2f421f82838b76e8badd81; no voters:
I20251214 21:04:16.197057 26324 raft_consensus.cc:2804] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:16.197152 26324 raft_consensus.cc:697] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: Becoming Leader. State: Replica: 5c8d6f43759d4d8baeb5fd0112ef1e5b, State: Running, Role: LEADER
I20251214 21:04:16.197283 26324 consensus_queue.cc:237] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:16.198767 26018 catalog_manager.cc:5654] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1). New cstate: current_term: 1 leader_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:16.221227 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:04:16.224573 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:16.224861 20608 tablet_replica.cc:333] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: stopping tablet replica
I20251214 21:04:16.225008 20608 raft_consensus.cc:2243] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:16.225178 20608 pending_rounds.cc:70] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Trying to abort 1 pending ops.
I20251214 21:04:16.225206 20608 pending_rounds.cc:77] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496665250787328 op_type: NO_OP noop_request { }
I20251214 21:04:16.225302 20608 raft_consensus.cc:2889] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:16.225363 20608 raft_consensus.cc:2272] T e79049cc2a004270a81cfc80a653c599 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:16.226011 20608 tablet_replica.cc:333] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: stopping tablet replica
I20251214 21:04:16.226109 20608 raft_consensus.cc:2243] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:16.226231 20608 pending_rounds.cc:70] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Trying to abort 1 pending ops.
I20251214 21:04:16.226269 20608 pending_rounds.cc:77] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496665039327232 op_type: NO_OP noop_request { }
I20251214 21:04:16.226328 20608 raft_consensus.cc:2889] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:16.226382 20608 raft_consensus.cc:2272] T 6a95d1b5b1d3444386611c94afaa30f9 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:16.226876 20608 tablet_replica.cc:333] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: stopping tablet replica
I20251214 21:04:16.226966 20608 raft_consensus.cc:2243] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:16.227047 20608 raft_consensus.cc:2272] T 791a25a30cb7404f9b176b9c45c5aaa8 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:16.227389 20608 tablet_replica.cc:333] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: stopping tablet replica
I20251214 21:04:16.227466 20608 raft_consensus.cc:2243] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:16.227578 20608 pending_rounds.cc:70] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Trying to abort 1 pending ops.
I20251214 21:04:16.227604 20608 pending_rounds.cc:77] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496665385414656 op_type: NO_OP noop_request { }
I20251214 21:04:16.227655 20608 raft_consensus.cc:2889] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:16.227706 20608 raft_consensus.cc:2272] T 102ad02708ab45e4b9c4eb531cfbc6f5 P 5c8d6f43759d4d8baeb5fd0112ef1e5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:16.240911 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
W20251214 21:04:16.648939 26161 consensus_peers.cc:597] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:16.714306 26346 consensus_queue.cc:1048] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:17.244005 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:17.245760 26355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:17.245838 26357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:17.245891 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:17.245963 26354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:17.246167 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:17.246212 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:17.246228 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746257246228 us; error 0 us; skew 500 ppm
I20251214 21:04:17.247087 20608 webserver.cc:492] Webserver started at http://127.20.32.4:36977/ using document root <none> and password file <none>
I20251214 21:04:17.247228 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:17.247278 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:17.247352 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:17.247711 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-3-root/instance:
uuid: "a3ac6c5944a544a191b465da229946da"
format_stamp: "Formatted at 2025-12-14 21:04:17 on dist-test-slave-bphs"
I20251214 21:04:17.249025 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:17.249897 26362 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:17.250128 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:17.250186 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-3-root
uuid: "a3ac6c5944a544a191b465da229946da"
format_stamp: "Formatted at 2025-12-14 21:04:17 on dist-test-slave-bphs"
I20251214 21:04:17.250248 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.NoRebalancingIfReplicasRecovering.1765746102914115-20608-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:17.263378 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:17.263785 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:17.264089 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:17.264525 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:17.264562 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:17.264605 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:17.264631 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:17.266340 26367 consensus_queue.cc:579] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Leader has been unable to successfully communicate with peer 5c8d6f43759d4d8baeb5fd0112ef1e5b for more than 1 seconds (1.167s)
W20251214 21:04:17.268180 26017 catalog_manager.cc:5332] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 791a25a30cb7404f9b176b9c45c5aaa8 with cas_config_opid_index -1: no extra replica candidate found for tablet 791a25a30cb7404f9b176b9c45c5aaa8 (table test-workload [id=7279a824a94243aea66c762164b9d614]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20251214 21:04:17.269253 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.4:41077
I20251214 21:04:17.269686 26430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.4:41077 every 8 connection(s)
I20251214 21:04:17.273662 26431 heartbeater.cc:344] Connected to a master server at 127.20.32.62:44069
I20251214 21:04:17.273775 26431 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:17.274003 26431 heartbeater.cc:507] Master 127.20.32.62:44069 requested a full tablet report, sending...
I20251214 21:04:17.274513 26017 ts_manager.cc:194] Registered new tserver with Master: a3ac6c5944a544a191b465da229946da (127.20.32.4:41077)
I20251214 21:04:17.275013 26017 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45042
I20251214 21:04:17.306766 26197 consensus_queue.cc:237] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:17.308200 26272 raft_consensus.cc:1275] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:04:17.308646 26367 consensus_queue.cc:1048] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251214 21:04:17.308830 26161 consensus_peers.cc:597] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:17.309921 26397 raft_consensus.cc:2955] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
I20251214 21:04:17.310316 26272 raft_consensus.cc:2955] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
I20251214 21:04:17.311512 26003 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 791a25a30cb7404f9b176b9c45c5aaa8 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 2)
I20251214 21:04:17.312350 26017 catalog_manager.cc:5654] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:17.312783 26163 consensus_peers.cc:597] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 -> Peer a3ac6c5944a544a191b465da229946da (127.20.32.4:41077): Couldn't send request to peer a3ac6c5944a544a191b465da229946da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 791a25a30cb7404f9b176b9c45c5aaa8. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:17.717554 26367 raft_consensus.cc:493] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:17.717751 26367 raft_consensus.cc:515] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:17.718161 26367 leader_election.cc:290] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:17.718642 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a95d1b5b1d3444386611c94afaa30f9" candidate_uuid: "d9bfc501ef2f421f82838b76e8badd81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" is_pre_election: true
I20251214 21:04:17.718788 26272 raft_consensus.cc:2468] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9bfc501ef2f421f82838b76e8badd81 in term 1.
I20251214 21:04:17.719131 26160 leader_election.cc:304] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters:
I20251214 21:04:17.719313 26367 raft_consensus.cc:2804] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251214 21:04:17.719324 26161 leader_election.cc:336] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:17.719383 26367 raft_consensus.cc:493] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:17.719424 26367 raft_consensus.cc:3060] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:17.720312 26367 raft_consensus.cc:515] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:17.720614 26367 leader_election.cc:290] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 election: Requested vote from peers 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:17.720965 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a95d1b5b1d3444386611c94afaa30f9" candidate_uuid: "d9bfc501ef2f421f82838b76e8badd81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4"
I20251214 21:04:17.721077 26272 raft_consensus.cc:3060] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Advancing to term 2
W20251214 21:04:17.721494 26161 leader_election.cc:336] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:17.721894 26272 raft_consensus.cc:2468] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9bfc501ef2f421f82838b76e8badd81 in term 2.
I20251214 21:04:17.722177 26160 leader_election.cc:304] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b
I20251214 21:04:17.722319 26367 raft_consensus.cc:2804] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:17.722409 26367 raft_consensus.cc:697] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Becoming Leader. State: Replica: d9bfc501ef2f421f82838b76e8badd81, State: Running, Role: LEADER
I20251214 21:04:17.722563 26367 consensus_queue.cc:237] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:17.724002 26018 catalog_manager.cc:5654] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: term changed from 1 to 2, leader changed from 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) to d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:17.746912 26443 ts_tablet_manager.cc:933] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: Initiating tablet copy from peer d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013)
I20251214 21:04:17.747294 26443 tablet_copy_client.cc:323] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:45013
I20251214 21:04:17.750686 26207 tablet_copy_service.cc:140] P d9bfc501ef2f421f82838b76e8badd81: Received BeginTabletCopySession request for tablet 791a25a30cb7404f9b176b9c45c5aaa8 from peer a3ac6c5944a544a191b465da229946da ({username='slave'} at 127.0.0.1:56552)
I20251214 21:04:17.750808 26207 tablet_copy_service.cc:161] P d9bfc501ef2f421f82838b76e8badd81: Beginning new tablet copy session on tablet 791a25a30cb7404f9b176b9c45c5aaa8 from peer a3ac6c5944a544a191b465da229946da at {username='slave'} at 127.0.0.1:56552: session id = a3ac6c5944a544a191b465da229946da-791a25a30cb7404f9b176b9c45c5aaa8
I20251214 21:04:17.751711 26207 tablet_copy_source_session.cc:215] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:17.752504 26443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791a25a30cb7404f9b176b9c45c5aaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:17.754388 26443 tablet_copy_client.cc:806] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:17.754524 26443 tablet_copy_client.cc:670] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:17.755705 26443 tablet_copy_client.cc:538] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:17.756850 26443 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: Bootstrap starting.
I20251214 21:04:17.759845 26443 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:17.760133 26443 tablet_bootstrap.cc:492] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: Bootstrap complete.
I20251214 21:04:17.760300 26443 ts_tablet_manager.cc:1403] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:04:17.760667 26443 raft_consensus.cc:359] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:17.760772 26443 raft_consensus.cc:740] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a3ac6c5944a544a191b465da229946da, State: Initialized, Role: LEARNER
I20251214 21:04:17.760846 26443 consensus_queue.cc:260] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:17.761137 26443 ts_tablet_manager.cc:1434] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:17.761266 26431 heartbeater.cc:499] Master 127.20.32.62:44069 was elected leader, sending a full tablet report...
I20251214 21:04:17.761747 26207 tablet_copy_service.cc:342] P d9bfc501ef2f421f82838b76e8badd81: Request end of tablet copy session a3ac6c5944a544a191b465da229946da-791a25a30cb7404f9b176b9c45c5aaa8 received from {username='slave'} at 127.0.0.1:56552
I20251214 21:04:17.761819 26207 tablet_copy_service.cc:434] P d9bfc501ef2f421f82838b76e8badd81: ending tablet copy session a3ac6c5944a544a191b465da229946da-791a25a30cb7404f9b176b9c45c5aaa8 on tablet 791a25a30cb7404f9b176b9c45c5aaa8 with peer a3ac6c5944a544a191b465da229946da
W20251214 21:04:17.827204 26066 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver 5c8d6f43759d4d8baeb5fd0112ef1e5b not available for placement
I20251214 21:04:18.018014 26448 raft_consensus.cc:493] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:18.018175 26448 raft_consensus.cc:515] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:18.018669 26448 leader_election.cc:290] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213), d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013)
W20251214 21:04:18.019896 26236 leader_election.cc:336] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:18.022173 26197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79049cc2a004270a81cfc80a653c599" candidate_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9bfc501ef2f421f82838b76e8badd81" is_pre_election: true
I20251214 21:04:18.022295 26197 raft_consensus.cc:2468] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1daaa5b29b2488c93b321af7c24f0c4 in term 1.
I20251214 21:04:18.022508 26236 leader_election.cc:304] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b
I20251214 21:04:18.022652 26448 raft_consensus.cc:2804] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:18.022711 26448 raft_consensus.cc:493] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:18.022745 26448 raft_consensus.cc:3060] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:18.025333 26448 raft_consensus.cc:515] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:18.025674 26448 leader_election.cc:290] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [CANDIDATE]: Term 2 election: Requested vote from peers 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213), d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013)
I20251214 21:04:18.026183 26197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79049cc2a004270a81cfc80a653c599" candidate_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9bfc501ef2f421f82838b76e8badd81"
I20251214 21:04:18.026294 26197 raft_consensus.cc:3060] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Advancing to term 2
W20251214 21:04:18.026525 26236 leader_election.cc:336] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:18.027024 26197 raft_consensus.cc:2468] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1daaa5b29b2488c93b321af7c24f0c4 in term 2.
I20251214 21:04:18.027266 26236 leader_election.cc:304] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b
I20251214 21:04:18.027410 26448 raft_consensus.cc:2804] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:18.027595 26448 raft_consensus.cc:697] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 LEADER]: Becoming Leader. State: Replica: c1daaa5b29b2488c93b321af7c24f0c4, State: Running, Role: LEADER
I20251214 21:04:18.027724 26448 consensus_queue.cc:237] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:18.029153 26018 catalog_manager.cc:5654] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 reported cstate change: term changed from 1 to 2, leader changed from 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) to c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3). New cstate: current_term: 2 leader_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } }
W20251214 21:04:18.126839 26161 consensus_peers.cc:597] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:18.128854 26401 raft_consensus.cc:1217] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20251214 21:04:18.289744 26272 raft_consensus.cc:1275] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251214 21:04:18.290195 26454 consensus_queue.cc:1048] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:18.320668 26454 consensus_queue.cc:579] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Leader has been unable to successfully communicate with peer 5c8d6f43759d4d8baeb5fd0112ef1e5b for more than 1 seconds (1.013s)
I20251214 21:04:18.324579 26454 raft_consensus.cc:493] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:18.324693 26454 raft_consensus.cc:515] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:18.325040 26454 leader_election.cc:290] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:18.325469 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "102ad02708ab45e4b9c4eb531cfbc6f5" candidate_uuid: "d9bfc501ef2f421f82838b76e8badd81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" is_pre_election: true
I20251214 21:04:18.325613 26272 raft_consensus.cc:2468] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9bfc501ef2f421f82838b76e8badd81 in term 1.
I20251214 21:04:18.325906 26160 leader_election.cc:304] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters:
W20251214 21:04:18.326063 26161 leader_election.cc:336] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:18.326085 26454 raft_consensus.cc:2804] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:18.326153 26454 raft_consensus.cc:493] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:18.326205 26454 raft_consensus.cc:3060] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:18.327088 26454 raft_consensus.cc:515] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:18.327407 26454 leader_election.cc:290] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 election: Requested vote from peers 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213), c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:18.327715 26272 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "102ad02708ab45e4b9c4eb531cfbc6f5" candidate_uuid: "d9bfc501ef2f421f82838b76e8badd81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1daaa5b29b2488c93b321af7c24f0c4"
I20251214 21:04:18.327818 26272 raft_consensus.cc:3060] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Advancing to term 2
W20251214 21:04:18.328238 26161 leader_election.cc:336] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:18.328581 26272 raft_consensus.cc:2468] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9bfc501ef2f421f82838b76e8badd81 in term 2.
I20251214 21:04:18.328817 26160 leader_election.cc:304] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1daaa5b29b2488c93b321af7c24f0c4, d9bfc501ef2f421f82838b76e8badd81; no voters: 5c8d6f43759d4d8baeb5fd0112ef1e5b
I20251214 21:04:18.328959 26454 raft_consensus.cc:2804] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:18.329048 26454 raft_consensus.cc:697] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Becoming Leader. State: Replica: d9bfc501ef2f421f82838b76e8badd81, State: Running, Role: LEADER
I20251214 21:04:18.329174 26454 consensus_queue.cc:237] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } }
I20251214 21:04:18.330521 26018 catalog_manager.cc:5654] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: term changed from 1 to 2, leader changed from 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) to d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:18.492030 26197 raft_consensus.cc:1275] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Refusing update from remote peer c1daaa5b29b2488c93b321af7c24f0c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251214 21:04:18.492530 26448 consensus_queue.cc:1048] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:04:18.495843 26236 consensus_peers.cc:597] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:18.690102 26367 raft_consensus.cc:1064] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81: attempting to promote NON_VOTER a3ac6c5944a544a191b465da229946da to VOTER
I20251214 21:04:18.690528 26367 consensus_queue.cc:237] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } }
I20251214 21:04:18.691799 26272 raft_consensus.cc:1275] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:04:18.691799 26401 raft_consensus.cc:1275] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 LEARNER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:04:18.692180 26462 consensus_queue.cc:1048] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:18.692328 26367 consensus_queue.cc:1048] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251214 21:04:18.692500 26161 consensus_peers.cc:597] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:18.693958 26462 raft_consensus.cc:2955] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:18.694355 26401 raft_consensus.cc:2955] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:18.695886 26272 raft_consensus.cc:2955] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:18.696399 26017 catalog_manager.cc:5654] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:04:18.699054 26197 consensus_queue.cc:237] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } }
I20251214 21:04:18.699947 26401 raft_consensus.cc:1275] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251214 21:04:18.699981 26272 raft_consensus.cc:1275] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251214 21:04:18.700249 26397 consensus_queue.cc:1048] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:18.700368 26367 consensus_queue.cc:1048] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:18.701596 26462 raft_consensus.cc:2955] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:18.702030 26272 raft_consensus.cc:2955] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:18.702028 26401 raft_consensus.cc:2955] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:18.703153 26003 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 791a25a30cb7404f9b176b9c45c5aaa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:04:18.703835 26016 catalog_manager.cc:5654] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New cstate: current_term: 1 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251214 21:04:18.706899 26003 catalog_manager.cc:4712] TS 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 791a25a30cb7404f9b176b9c45c5aaa8: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
W20251214 21:04:18.827941 26066 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver 5c8d6f43759d4d8baeb5fd0112ef1e5b not available for placement
W20251214 21:04:18.831310 26161 consensus_peers.cc:597] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:18.862599 26272 raft_consensus.cc:1275] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251214 21:04:18.863413 26462 consensus_queue.cc:1048] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:19.099253 26460 consensus_queue.cc:579] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Leader has been unable to successfully communicate with peer 5c8d6f43759d4d8baeb5fd0112ef1e5b for more than 1 seconds (1.071s)
I20251214 21:04:19.101928 26272 consensus_queue.cc:237] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:19.103382 26197 raft_consensus.cc:1275] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Refusing update from remote peer c1daaa5b29b2488c93b321af7c24f0c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251214 21:04:19.103822 26236 consensus_peers.cc:597] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:19.103848 26470 consensus_queue.cc:1048] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:04:19.105829 26469 raft_consensus.cc:2955] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
I20251214 21:04:19.106112 26197 raft_consensus.cc:2955] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
W20251214 21:04:19.107636 26238 consensus_peers.cc:597] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 -> Peer a3ac6c5944a544a191b465da229946da (127.20.32.4:41077): Couldn't send request to peer a3ac6c5944a544a191b465da229946da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e79049cc2a004270a81cfc80a653c599. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:19.108212 26002 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e79049cc2a004270a81cfc80a653c599 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251214 21:04:19.108732 26018 catalog_manager.cc:5654] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 reported cstate change: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New cstate: current_term: 2 leader_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:19.148306 26462 consensus_queue.cc:579] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Leader has been unable to successfully communicate with peer 5c8d6f43759d4d8baeb5fd0112ef1e5b for more than 1 seconds (1.426s)
I20251214 21:04:19.150753 26197 consensus_queue.cc:237] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:19.152057 26272 raft_consensus.cc:1275] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251214 21:04:19.152160 26163 consensus_peers.cc:597] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 -> Peer a3ac6c5944a544a191b465da229946da (127.20.32.4:41077): Couldn't send request to peer a3ac6c5944a544a191b465da229946da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a95d1b5b1d3444386611c94afaa30f9. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:19.152396 26462 consensus_queue.cc:1048] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251214 21:04:19.152518 26161 consensus_peers.cc:597] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:19.153676 26367 raft_consensus.cc:2955] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
I20251214 21:04:19.154071 26272 raft_consensus.cc:2955] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
I20251214 21:04:19.155314 26003 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 6a95d1b5b1d3444386611c94afaa30f9 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251214 21:04:19.156129 26017 catalog_manager.cc:5654] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New cstate: current_term: 2 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:19.534725 26475 ts_tablet_manager.cc:933] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: Initiating tablet copy from peer c1daaa5b29b2488c93b321af7c24f0c4 (127.20.32.3:39235)
I20251214 21:04:19.535046 26475 tablet_copy_client.cc:323] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:39235
I20251214 21:04:19.539438 26282 tablet_copy_service.cc:140] P c1daaa5b29b2488c93b321af7c24f0c4: Received BeginTabletCopySession request for tablet e79049cc2a004270a81cfc80a653c599 from peer a3ac6c5944a544a191b465da229946da ({username='slave'} at 127.0.0.1:49104)
I20251214 21:04:19.539577 26282 tablet_copy_service.cc:161] P c1daaa5b29b2488c93b321af7c24f0c4: Beginning new tablet copy session on tablet e79049cc2a004270a81cfc80a653c599 from peer a3ac6c5944a544a191b465da229946da at {username='slave'} at 127.0.0.1:49104: session id = a3ac6c5944a544a191b465da229946da-e79049cc2a004270a81cfc80a653c599
I20251214 21:04:19.540340 26282 tablet_copy_source_session.cc:215] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:19.541209 26475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79049cc2a004270a81cfc80a653c599. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:19.543114 26475 tablet_copy_client.cc:806] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:19.543258 26475 tablet_copy_client.cc:670] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:19.544370 26475 tablet_copy_client.cc:538] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:19.545573 26475 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: Bootstrap starting.
I20251214 21:04:19.548605 26475 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:19.548810 26475 tablet_bootstrap.cc:492] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: Bootstrap complete.
I20251214 21:04:19.548935 26475 ts_tablet_manager.cc:1403] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:19.549283 26475 raft_consensus.cc:359] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:19.549384 26475 raft_consensus.cc:740] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a3ac6c5944a544a191b465da229946da, State: Initialized, Role: LEARNER
I20251214 21:04:19.549458 26475 consensus_queue.cc:260] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:19.549788 26475 ts_tablet_manager.cc:1434] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:19.550307 26282 tablet_copy_service.cc:342] P c1daaa5b29b2488c93b321af7c24f0c4: Request end of tablet copy session a3ac6c5944a544a191b465da229946da-e79049cc2a004270a81cfc80a653c599 received from {username='slave'} at 127.0.0.1:49104
I20251214 21:04:19.550395 26282 tablet_copy_service.cc:434] P c1daaa5b29b2488c93b321af7c24f0c4: ending tablet copy session a3ac6c5944a544a191b465da229946da-e79049cc2a004270a81cfc80a653c599 on tablet e79049cc2a004270a81cfc80a653c599 with peer a3ac6c5944a544a191b465da229946da
I20251214 21:04:19.598547 26475 ts_tablet_manager.cc:933] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: Initiating tablet copy from peer d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013)
I20251214 21:04:19.598922 26475 tablet_copy_client.cc:323] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:45013
I20251214 21:04:19.599444 26207 tablet_copy_service.cc:140] P d9bfc501ef2f421f82838b76e8badd81: Received BeginTabletCopySession request for tablet 6a95d1b5b1d3444386611c94afaa30f9 from peer a3ac6c5944a544a191b465da229946da ({username='slave'} at 127.0.0.1:56552)
I20251214 21:04:19.599550 26207 tablet_copy_service.cc:161] P d9bfc501ef2f421f82838b76e8badd81: Beginning new tablet copy session on tablet 6a95d1b5b1d3444386611c94afaa30f9 from peer a3ac6c5944a544a191b465da229946da at {username='slave'} at 127.0.0.1:56552: session id = a3ac6c5944a544a191b465da229946da-6a95d1b5b1d3444386611c94afaa30f9
I20251214 21:04:19.600361 26207 tablet_copy_source_session.cc:215] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:19.601222 26475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a95d1b5b1d3444386611c94afaa30f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:19.603269 26475 tablet_copy_client.cc:806] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:19.603403 26475 tablet_copy_client.cc:670] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:19.604805 26475 tablet_copy_client.cc:538] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:19.606112 26475 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: Bootstrap starting.
I20251214 21:04:19.608961 26475 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:19.609176 26475 tablet_bootstrap.cc:492] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: Bootstrap complete.
I20251214 21:04:19.609330 26475 ts_tablet_manager.cc:1403] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:19.609730 26475 raft_consensus.cc:359] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:19.609845 26475 raft_consensus.cc:740] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a3ac6c5944a544a191b465da229946da, State: Initialized, Role: LEARNER
I20251214 21:04:19.609941 26475 consensus_queue.cc:260] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:19.610165 26475 ts_tablet_manager.cc:1434] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:19.610733 26207 tablet_copy_service.cc:342] P d9bfc501ef2f421f82838b76e8badd81: Request end of tablet copy session a3ac6c5944a544a191b465da229946da-6a95d1b5b1d3444386611c94afaa30f9 received from {username='slave'} at 127.0.0.1:56552
I20251214 21:04:19.610821 26207 tablet_copy_service.cc:434] P d9bfc501ef2f421f82838b76e8badd81: ending tablet copy session a3ac6c5944a544a191b465da229946da-6a95d1b5b1d3444386611c94afaa30f9 on tablet 6a95d1b5b1d3444386611c94afaa30f9 with peer a3ac6c5944a544a191b465da229946da
W20251214 21:04:19.720012 26236 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111) [suppressed 28 similar messages]
W20251214 21:04:19.828616 26066 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver 5c8d6f43759d4d8baeb5fd0112ef1e5b not available for placement
W20251214 21:04:19.861753 26003 catalog_manager.cc:4712] TS 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 791a25a30cb7404f9b176b9c45c5aaa8: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:19.887230 26397 consensus_queue.cc:579] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Leader has been unable to successfully communicate with peer 5c8d6f43759d4d8baeb5fd0112ef1e5b for more than 1 seconds (1.558s)
I20251214 21:04:19.889791 26197 consensus_queue.cc:237] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:19.891041 26272 raft_consensus.cc:1275] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251214 21:04:19.891219 26163 consensus_peers.cc:597] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 -> Peer a3ac6c5944a544a191b465da229946da (127.20.32.4:41077): Couldn't send request to peer a3ac6c5944a544a191b465da229946da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 102ad02708ab45e4b9c4eb531cfbc6f5. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:19.891531 26487 consensus_queue.cc:1048] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251214 21:04:19.891748 26161 consensus_peers.cc:597] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:19.893198 26488 raft_consensus.cc:2955] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
I20251214 21:04:19.893599 26272 raft_consensus.cc:2955] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
I20251214 21:04:19.894881 26003 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 102ad02708ab45e4b9c4eb531cfbc6f5 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251214 21:04:19.895750 26018 catalog_manager.cc:5654] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 reported cstate change: config changed from index -1 to 2, NON_VOTER a3ac6c5944a544a191b465da229946da (127.20.32.4) added. New cstate: current_term: 2 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } } }
I20251214 21:04:19.981989 26401 raft_consensus.cc:1217] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20251214 21:04:20.027662 26401 raft_consensus.cc:1217] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20251214 21:04:20.151146 26487 consensus_queue.cc:579] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Leader has been unable to successfully communicate with peer 5c8d6f43759d4d8baeb5fd0112ef1e5b for more than 1 seconds (1.000s)
I20251214 21:04:20.225837 26496 consensus_queue.cc:579] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Leader has been unable to successfully communicate with peer 5c8d6f43759d4d8baeb5fd0112ef1e5b for more than 1 seconds (1.124s)
I20251214 21:04:20.449916 26470 raft_consensus.cc:1064] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4: attempting to promote NON_VOTER a3ac6c5944a544a191b465da229946da to VOTER
I20251214 21:04:20.450356 26470 consensus_queue.cc:237] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } }
I20251214 21:04:20.451781 26197 raft_consensus.cc:1275] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Refusing update from remote peer c1daaa5b29b2488c93b321af7c24f0c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:20.451782 26401 raft_consensus.cc:1275] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Refusing update from remote peer c1daaa5b29b2488c93b321af7c24f0c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:20.452180 26496 consensus_queue.cc:1048] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251214 21:04:20.452539 26236 consensus_peers.cc:597] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:20.452590 26470 consensus_queue.cc:1048] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:20.454669 26470 raft_consensus.cc:2955] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.455117 26401 raft_consensus.cc:2955] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.456961 26197 raft_consensus.cc:2955] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.457423 26017 catalog_manager.cc:5654] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da reported cstate change: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.458321 26487 raft_consensus.cc:1064] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81: attempting to promote NON_VOTER a3ac6c5944a544a191b465da229946da to VOTER
I20251214 21:04:20.458704 26487 consensus_queue.cc:237] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } }
I20251214 21:04:20.460407 26403 raft_consensus.cc:1275] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:20.460471 26272 raft_consensus.cc:1275] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:20.461202 26508 consensus_queue.cc:1048] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:20.461458 26507 consensus_queue.cc:1048] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251214 21:04:20.461753 26161 consensus_peers.cc:597] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:20.462321 26272 consensus_queue.cc:237] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } }
I20251214 21:04:20.463455 26197 raft_consensus.cc:1275] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Refusing update from remote peer c1daaa5b29b2488c93b321af7c24f0c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:20.463462 26401 raft_consensus.cc:1275] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Refusing update from remote peer c1daaa5b29b2488c93b321af7c24f0c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:20.463791 26470 consensus_queue.cc:1048] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:20.463917 26495 consensus_queue.cc:1048] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:20.464277 26511 ts_tablet_manager.cc:933] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: Initiating tablet copy from peer d9bfc501ef2f421f82838b76e8badd81 (127.20.32.2:45013)
I20251214 21:04:20.464588 26511 tablet_copy_client.cc:323] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:45013
I20251214 21:04:20.465016 26207 tablet_copy_service.cc:140] P d9bfc501ef2f421f82838b76e8badd81: Received BeginTabletCopySession request for tablet 102ad02708ab45e4b9c4eb531cfbc6f5 from peer a3ac6c5944a544a191b465da229946da ({username='slave'} at 127.0.0.1:56552)
I20251214 21:04:20.465106 26207 tablet_copy_service.cc:161] P d9bfc501ef2f421f82838b76e8badd81: Beginning new tablet copy session on tablet 102ad02708ab45e4b9c4eb531cfbc6f5 from peer a3ac6c5944a544a191b465da229946da at {username='slave'} at 127.0.0.1:56552: session id = a3ac6c5944a544a191b465da229946da-102ad02708ab45e4b9c4eb531cfbc6f5
I20251214 21:04:20.465319 26401 raft_consensus.cc:2955] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.465412 26495 raft_consensus.cc:2955] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.466048 26207 tablet_copy_source_session.cc:215] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:20.466871 26511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102ad02708ab45e4b9c4eb531cfbc6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:20.467108 26002 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet e79049cc2a004270a81cfc80a653c599 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:04:20.467504 26197 raft_consensus.cc:2955] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.467778 26016 catalog_manager.cc:5654] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da reported cstate change: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.467854 26018 catalog_manager.cc:5654] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 reported cstate change: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New cstate: current_term: 2 leader_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:04:20.469249 26403 raft_consensus.cc:2955] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.464941 26507 raft_consensus.cc:2955] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.470811 26511 tablet_copy_client.cc:806] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:20.471006 26511 tablet_copy_client.cc:670] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:20.472280 26511 tablet_copy_client.cc:538] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:20.472573 26271 raft_consensus.cc:2955] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.473623 26511 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: Bootstrap starting.
I20251214 21:04:20.476204 26197 consensus_queue.cc:237] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } }
I20251214 21:04:20.476651 26511 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:20.476881 26511 tablet_bootstrap.cc:492] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: Bootstrap complete.
I20251214 21:04:20.477034 26511 ts_tablet_manager.cc:1403] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: Time spent bootstrapping tablet: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:20.477084 26271 raft_consensus.cc:1275] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:20.477121 26403 raft_consensus.cc:1275] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:20.477416 26507 consensus_queue.cc:1048] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:20.477402 26511 raft_consensus.cc:359] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:20.477540 26511 raft_consensus.cc:740] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a3ac6c5944a544a191b465da229946da, State: Initialized, Role: LEARNER
I20251214 21:04:20.477562 26508 consensus_queue.cc:1048] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:20.477634 26511 consensus_queue.cc:260] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: true } }
I20251214 21:04:20.477919 26511 ts_tablet_manager.cc:1434] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:20.478431 26207 tablet_copy_service.cc:342] P d9bfc501ef2f421f82838b76e8badd81: Request end of tablet copy session a3ac6c5944a544a191b465da229946da-102ad02708ab45e4b9c4eb531cfbc6f5 received from {username='slave'} at 127.0.0.1:56552
I20251214 21:04:20.478502 26207 tablet_copy_service.cc:434] P d9bfc501ef2f421f82838b76e8badd81: ending tablet copy session a3ac6c5944a544a191b465da229946da-102ad02708ab45e4b9c4eb531cfbc6f5 on tablet 102ad02708ab45e4b9c4eb531cfbc6f5 with peer a3ac6c5944a544a191b465da229946da
I20251214 21:04:20.479290 26508 raft_consensus.cc:2955] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.480114 26403 raft_consensus.cc:2955] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.481407 26003 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 6a95d1b5b1d3444386611c94afaa30f9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:04:20.481407 26271 raft_consensus.cc:2955] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:20.482574 26018 catalog_manager.cc:5654] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New cstate: current_term: 2 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251214 21:04:20.829391 26066 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver 5c8d6f43759d4d8baeb5fd0112ef1e5b not available for placement
I20251214 21:04:20.900506 26403 raft_consensus.cc:1217] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
W20251214 21:04:20.931388 26003 catalog_manager.cc:4712] TS 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 791a25a30cb7404f9b176b9c45c5aaa8: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:21.310354 26507 consensus_queue.cc:579] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Leader has been unable to successfully communicate with peer 5c8d6f43759d4d8baeb5fd0112ef1e5b for more than 1 seconds (1.420s)
I20251214 21:04:21.445844 26507 raft_consensus.cc:1064] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81: attempting to promote NON_VOTER a3ac6c5944a544a191b465da229946da to VOTER
I20251214 21:04:21.446246 26507 consensus_queue.cc:237] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } }
I20251214 21:04:21.447499 26403 raft_consensus.cc:1275] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 LEARNER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:21.447501 26271 raft_consensus.cc:1275] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:21.447867 26507 consensus_queue.cc:1048] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:21.448007 26521 consensus_queue.cc:1048] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20251214 21:04:21.448158 26161 consensus_peers.cc:597] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 -> Peer 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): Couldn't send request to peer 5c8d6f43759d4d8baeb5fd0112ef1e5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:21.449759 26508 raft_consensus.cc:2955] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:21.450148 26271 raft_consensus.cc:2955] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:21.451313 26403 raft_consensus.cc:2955] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:21.451920 26016 catalog_manager.cc:5654] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: config changed from index 2 to 3, a3ac6c5944a544a191b465da229946da (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5c8d6f43759d4d8baeb5fd0112ef1e5b" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:04:21.454980 26197 consensus_queue.cc:237] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } }
I20251214 21:04:21.455945 26271 raft_consensus.cc:1275] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:21.456008 26403 raft_consensus.cc:1275] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Refusing update from remote peer d9bfc501ef2f421f82838b76e8badd81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:21.456357 26521 consensus_queue.cc:1048] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:21.456488 26507 consensus_queue.cc:1048] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:21.457847 26521 raft_consensus.cc:2955] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:21.458288 26271 raft_consensus.cc:2955] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:21.458451 26403 raft_consensus.cc:2955] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } } }
I20251214 21:04:21.459883 26003 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 102ad02708ab45e4b9c4eb531cfbc6f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:04:21.460407 26018 catalog_manager.cc:5654] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 reported cstate change: config changed from index 3 to 4, VOTER 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1) evicted. New cstate: current_term: 2 leader_uuid: "d9bfc501ef2f421f82838b76e8badd81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d9bfc501ef2f421f82838b76e8badd81" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1daaa5b29b2488c93b321af7c24f0c4" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 39235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ac6c5944a544a191b465da229946da" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20251214 21:04:22.077050 26003 catalog_manager.cc:4712] TS 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 102ad02708ab45e4b9c4eb531cfbc6f5: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
W20251214 21:04:23.665480 26003 catalog_manager.cc:4712] TS 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 102ad02708ab45e4b9c4eb531cfbc6f5: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:24.295634 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:04:24.299304 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:24.299536 20608 tablet_replica.cc:333] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81: stopping tablet replica
I20251214 21:04:24.299659 20608 raft_consensus.cc:2243] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:24.299868 20608 raft_consensus.cc:2272] T 791a25a30cb7404f9b176b9c45c5aaa8 P d9bfc501ef2f421f82838b76e8badd81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.300323 20608 tablet_replica.cc:333] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81: stopping tablet replica
I20251214 21:04:24.300415 20608 raft_consensus.cc:2243] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:04:24.300552 20608 raft_consensus.cc:2272] T 102ad02708ab45e4b9c4eb531cfbc6f5 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.300849 20608 tablet_replica.cc:333] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81: stopping tablet replica
I20251214 21:04:24.300920 20608 raft_consensus.cc:2243] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:04:24.301025 20608 raft_consensus.cc:2272] T 6a95d1b5b1d3444386611c94afaa30f9 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.301292 20608 tablet_replica.cc:333] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81: stopping tablet replica
I20251214 21:04:24.301354 20608 raft_consensus.cc:2243] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:24.301447 20608 raft_consensus.cc:2272] T e79049cc2a004270a81cfc80a653c599 P d9bfc501ef2f421f82838b76e8badd81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.304503 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:04:24.307247 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:04:24.311336 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:24.311549 20608 tablet_replica.cc:333] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4: stopping tablet replica
I20251214 21:04:24.311668 20608 raft_consensus.cc:2243] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:24.311815 20608 raft_consensus.cc:2272] T 6a95d1b5b1d3444386611c94afaa30f9 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.312650 20608 tablet_replica.cc:333] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4: stopping tablet replica
I20251214 21:04:24.312775 20608 raft_consensus.cc:2243] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:04:24.312927 20608 raft_consensus.cc:2272] T e79049cc2a004270a81cfc80a653c599 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.313269 20608 tablet_replica.cc:333] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4: stopping tablet replica
I20251214 21:04:24.313366 20608 raft_consensus.cc:2243] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:24.313463 20608 raft_consensus.cc:2272] T 791a25a30cb7404f9b176b9c45c5aaa8 P c1daaa5b29b2488c93b321af7c24f0c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.313783 20608 tablet_replica.cc:333] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4: stopping tablet replica
I20251214 21:04:24.313859 20608 raft_consensus.cc:2243] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:24.313947 20608 raft_consensus.cc:2272] T 102ad02708ab45e4b9c4eb531cfbc6f5 P c1daaa5b29b2488c93b321af7c24f0c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.327023 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:04:24.329308 20608 tablet_server.cc:178] TabletServer@127.20.32.4:0 shutting down...
I20251214 21:04:24.332590 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:24.332772 20608 tablet_replica.cc:333] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da: stopping tablet replica
I20251214 21:04:24.332888 20608 raft_consensus.cc:2243] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:24.333007 20608 raft_consensus.cc:2272] T 102ad02708ab45e4b9c4eb531cfbc6f5 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.333415 20608 tablet_replica.cc:333] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da: stopping tablet replica
I20251214 21:04:24.333491 20608 raft_consensus.cc:2243] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:24.333570 20608 raft_consensus.cc:2272] T 6a95d1b5b1d3444386611c94afaa30f9 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.333923 20608 tablet_replica.cc:333] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da: stopping tablet replica
I20251214 21:04:24.333997 20608 raft_consensus.cc:2243] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:24.334074 20608 raft_consensus.cc:2272] T 791a25a30cb7404f9b176b9c45c5aaa8 P a3ac6c5944a544a191b465da229946da [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.334347 20608 tablet_replica.cc:333] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da: stopping tablet replica
I20251214 21:04:24.334422 20608 raft_consensus.cc:2243] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:24.334497 20608 raft_consensus.cc:2272] T e79049cc2a004270a81cfc80a653c599 P a3ac6c5944a544a191b465da229946da [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:24.346887 20608 tablet_server.cc:195] TabletServer@127.20.32.4:0 shutdown complete.
I20251214 21:04:24.349248 20608 master.cc:561] Master@127.20.32.62:44069 shutting down...
W20251214 21:04:24.744580 26003 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111) [suppressed 37 similar messages]
W20251214 21:04:24.745219 26003 catalog_manager.cc:4712] TS 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6a95d1b5b1d3444386611c94afaa30f9: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
W20251214 21:04:25.751247 26003 catalog_manager.cc:4712] TS 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 102ad02708ab45e4b9c4eb531cfbc6f5: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
W20251214 21:04:27.172830 26003 catalog_manager.cc:4712] TS 5c8d6f43759d4d8baeb5fd0112ef1e5b (127.20.32.1:33213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 791a25a30cb7404f9b176b9c45c5aaa8: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33213: connect: Connection refused (error 111)
I20251214 21:04:27.230629 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:27.230887 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:27.230962 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 11b636413d5c495bb34a0153e023af05: stopping tablet replica
I20251214 21:04:27.243729 20608 master.cc:583] Master@127.20.32.62:44069 shutdown complete.
[ OK ] AutoRebalancerTest.NoRebalancingIfReplicasRecovering (12479 ms)
[ RUN ] AutoRebalancerTest.TestHandlingFailedTservers
I20251214 21:04:27.252441 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:42757
I20251214 21:04:27.252795 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:27.254491 26538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:27.254683 26541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:27.254745 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:27.254786 26539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:27.254977 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:27.255018 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:27.255038 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746267255037 us; error 0 us; skew 500 ppm
I20251214 21:04:27.255875 20608 webserver.cc:492] Webserver started at http://127.20.32.62:46527/ using document root <none> and password file <none>
I20251214 21:04:27.256018 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:27.256067 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:27.256143 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:27.256541 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "615d9df749f9473b98a9d971f4dd1e8c"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:27.257922 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:27.258816 26546 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.259073 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:27.259141 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "615d9df749f9473b98a9d971f4dd1e8c"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:27.259212 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:27.277174 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:27.277561 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:27.281988 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:42757
I20251214 21:04:27.284731 26598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:42757 every 8 connection(s)
I20251214 21:04:27.285161 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:27.287117 26599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c: Bootstrap starting.
I20251214 21:04:27.287873 26599 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:27.288843 26599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c: No bootstrap required, opened a new log
I20251214 21:04:27.289198 26599 raft_consensus.cc:359] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d9df749f9473b98a9d971f4dd1e8c" member_type: VOTER }
I20251214 21:04:27.289305 26599 raft_consensus.cc:385] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:27.289338 26599 raft_consensus.cc:740] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615d9df749f9473b98a9d971f4dd1e8c, State: Initialized, Role: FOLLOWER
I20251214 21:04:27.289458 26599 consensus_queue.cc:260] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d9df749f9473b98a9d971f4dd1e8c" member_type: VOTER }
I20251214 21:04:27.289525 26599 raft_consensus.cc:399] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:27.289559 26599 raft_consensus.cc:493] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:27.289604 26599 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:27.290282 26599 raft_consensus.cc:515] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d9df749f9473b98a9d971f4dd1e8c" member_type: VOTER }
I20251214 21:04:27.290392 26599 leader_election.cc:304] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 615d9df749f9473b98a9d971f4dd1e8c; no voters:
I20251214 21:04:27.290560 26599 leader_election.cc:290] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:27.290679 26602 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:27.290872 26602 raft_consensus.cc:697] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 1 LEADER]: Becoming Leader. State: Replica: 615d9df749f9473b98a9d971f4dd1e8c, State: Running, Role: LEADER
I20251214 21:04:27.290990 26599 sys_catalog.cc:565] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:27.290997 26602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d9df749f9473b98a9d971f4dd1e8c" member_type: VOTER }
I20251214 21:04:27.291428 26603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "615d9df749f9473b98a9d971f4dd1e8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d9df749f9473b98a9d971f4dd1e8c" member_type: VOTER } }
I20251214 21:04:27.291467 26604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 615d9df749f9473b98a9d971f4dd1e8c. Latest consensus state: current_term: 1 leader_uuid: "615d9df749f9473b98a9d971f4dd1e8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d9df749f9473b98a9d971f4dd1e8c" member_type: VOTER } }
I20251214 21:04:27.291586 26603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:27.291620 26604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:27.292160 26608 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:27.293044 26608 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:27.293247 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:04:27.295030 26608 catalog_manager.cc:1357] Generated new cluster ID: 2d820c3821ae4627a41b4c9b931ca940
I20251214 21:04:27.295091 26608 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:27.302873 26608 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:27.303445 26608 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:27.313637 26608 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c: Generated new TSK 0
I20251214 21:04:27.313848 26608 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:27.325682 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:27.327730 26621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:27.327746 26623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:27.327766 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:27.327725 26620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:27.328119 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:27.328164 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:27.328179 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746267328179 us; error 0 us; skew 500 ppm
I20251214 21:04:27.328974 20608 webserver.cc:492] Webserver started at http://127.20.32.1:38379/ using document root <none> and password file <none>
I20251214 21:04:27.329111 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:27.329156 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:27.329257 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:27.329634 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "b6197c79bf5a44cf9c5ffd0767267463"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:27.331046 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:27.331974 26628 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.332237 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:27.332302 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "b6197c79bf5a44cf9c5ffd0767267463"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:27.332369 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:27.347514 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:27.347903 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:27.348176 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:27.348639 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:27.348675 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.348706 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:27.348731 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.352802 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:33051
I20251214 21:04:27.352826 26691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:33051 every 8 connection(s)
I20251214 21:04:27.353638 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:27.355253 26696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:27.355279 26697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:27.355331 26699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:27.355525 20608 server_base.cc:1047] running on GCE node
I20251214 21:04:27.355683 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:27.355720 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:27.355741 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746267355740 us; error 0 us; skew 500 ppm
I20251214 21:04:27.356607 20608 webserver.cc:492] Webserver started at http://127.20.32.2:44843/ using document root <none> and password file <none>
I20251214 21:04:27.356761 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:27.356817 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:27.356890 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:27.357415 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "ef4aa669b37244a4af7b55f17c99ae80"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:27.357939 26692 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42757
I20251214 21:04:27.358027 26692 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:27.358220 26692 heartbeater.cc:507] Master 127.20.32.62:42757 requested a full tablet report, sending...
I20251214 21:04:27.358774 26563 ts_manager.cc:194] Registered new tserver with Master: b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051)
I20251214 21:04:27.358999 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:04:27.359508 26563 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56802
I20251214 21:04:27.359869 26704 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.360157 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:27.360219 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "ef4aa669b37244a4af7b55f17c99ae80"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:27.360283 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:27.378451 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:27.378876 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:27.379150 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:27.379607 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:27.379647 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.379688 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:27.379715 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.383414 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:45565
I20251214 21:04:27.383466 26767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:45565 every 8 connection(s)
I20251214 21:04:27.384162 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:27.385927 26771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:27.385934 26772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:27.386029 26774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:27.386165 20608 server_base.cc:1047] running on GCE node
I20251214 21:04:27.386334 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:27.386377 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:27.386395 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746267386395 us; error 0 us; skew 500 ppm
I20251214 21:04:27.387248 20608 webserver.cc:492] Webserver started at http://127.20.32.3:37747/ using document root <none> and password file <none>
I20251214 21:04:27.387406 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:27.387452 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:27.387521 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:27.387940 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "28d8e47dbd69466dbfa4256b374f3375"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:27.388329 26768 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42757
I20251214 21:04:27.388419 26768 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:27.388720 26768 heartbeater.cc:507] Master 127.20.32.62:42757 requested a full tablet report, sending...
I20251214 21:04:27.389284 26563 ts_manager.cc:194] Registered new tserver with Master: ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:27.389314 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:27.389811 26563 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56818
I20251214 21:04:27.390224 26779 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.390450 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:27.390508 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "28d8e47dbd69466dbfa4256b374f3375"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:27.390578 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:27.399224 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:27.399633 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:27.399896 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:27.400336 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:27.400373 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.400413 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:27.400440 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:27.405001 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:33147
I20251214 21:04:27.405102 26842 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:33147 every 8 connection(s)
I20251214 21:04:27.409373 26843 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42757
I20251214 21:04:27.409487 26843 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:27.409737 26843 heartbeater.cc:507] Master 127.20.32.62:42757 requested a full tablet report, sending...
I20251214 21:04:27.410406 26563 ts_manager.cc:194] Registered new tserver with Master: 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:27.410977 26563 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56834
I20251214 21:04:27.411039 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005655816s
I20251214 21:04:28.360435 26692 heartbeater.cc:499] Master 127.20.32.62:42757 was elected leader, sending a full tablet report...
I20251214 21:04:28.390707 26768 heartbeater.cc:499] Master 127.20.32.62:42757 was elected leader, sending a full tablet report...
I20251214 21:04:28.411927 26843 heartbeater.cc:499] Master 127.20.32.62:42757 was elected leader, sending a full tablet report...
I20251214 21:04:28.437628 20608 test_util.cc:276] Using random seed: -686293896
I20251214 21:04:28.449250 26563 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56842:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:04:28.449836 26563 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:04:28.460444 26656 tablet_service.cc:1505] Processing CreateTablet for tablet 2e7ecef437b54cb0b0c4cf5ff4e55799 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:28.460541 26732 tablet_service.cc:1505] Processing CreateTablet for tablet 2e7ecef437b54cb0b0c4cf5ff4e55799 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:28.460541 26731 tablet_service.cc:1505] Processing CreateTablet for tablet f30ac5dafe604761b15603b2c748ad26 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:28.460685 26730 tablet_service.cc:1505] Processing CreateTablet for tablet 5422d839d405479cb53a4e442395b4cf (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:28.460798 26656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7ecef437b54cb0b0c4cf5ff4e55799. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.460902 26731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30ac5dafe604761b15603b2c748ad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.460981 26729 tablet_service.cc:1505] Processing CreateTablet for tablet 61deee6d8e6b4dc39389a5b3662a98c0 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:28.461064 26732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7ecef437b54cb0b0c4cf5ff4e55799. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.461184 26729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61deee6d8e6b4dc39389a5b3662a98c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.461882 26730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5422d839d405479cb53a4e442395b4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.463421 26807 tablet_service.cc:1505] Processing CreateTablet for tablet 2e7ecef437b54cb0b0c4cf5ff4e55799 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:28.463434 26655 tablet_service.cc:1505] Processing CreateTablet for tablet f30ac5dafe604761b15603b2c748ad26 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:28.463661 26807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7ecef437b54cb0b0c4cf5ff4e55799. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.463634 26654 tablet_service.cc:1505] Processing CreateTablet for tablet 5422d839d405479cb53a4e442395b4cf (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:28.463661 26655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30ac5dafe604761b15603b2c748ad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.463873 26654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5422d839d405479cb53a4e442395b4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.465833 26865 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap starting.
I20251214 21:04:28.465976 26806 tablet_service.cc:1505] Processing CreateTablet for tablet f30ac5dafe604761b15603b2c748ad26 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:28.466049 26653 tablet_service.cc:1505] Processing CreateTablet for tablet 61deee6d8e6b4dc39389a5b3662a98c0 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:28.466183 26806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30ac5dafe604761b15603b2c748ad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.466275 26653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61deee6d8e6b4dc39389a5b3662a98c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.466784 26865 tablet_bootstrap.cc:654] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.467545 26864 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap starting.
I20251214 21:04:28.468065 26805 tablet_service.cc:1505] Processing CreateTablet for tablet 5422d839d405479cb53a4e442395b4cf (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:28.468250 26805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5422d839d405479cb53a4e442395b4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.468477 26864 tablet_bootstrap.cc:654] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.469209 26863 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap starting.
I20251214 21:04:28.469587 26864 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: No bootstrap required, opened a new log
I20251214 21:04:28.469681 26864 ts_tablet_manager.cc:1403] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:28.469981 26804 tablet_service.cc:1505] Processing CreateTablet for tablet 61deee6d8e6b4dc39389a5b3662a98c0 (DEFAULT_TABLE table=test-workload [id=006e64ee03664a609c678d120580e7b7]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:28.470148 26863 tablet_bootstrap.cc:654] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.470191 26804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61deee6d8e6b4dc39389a5b3662a98c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:28.470131 26864 raft_consensus.cc:359] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.470257 26864 raft_consensus.cc:385] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.470304 26864 raft_consensus.cc:740] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.470455 26864 consensus_queue.cc:260] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.470790 26864 ts_tablet_manager.cc:1434] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:28.471148 26865 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: No bootstrap required, opened a new log
I20251214 21:04:28.471221 26865 ts_tablet_manager.cc:1403] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251214 21:04:28.471251 26863 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: No bootstrap required, opened a new log
I20251214 21:04:28.471650 26865 raft_consensus.cc:359] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.471735 26865 raft_consensus.cc:385] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.471762 26865 raft_consensus.cc:740] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.471879 26865 consensus_queue.cc:260] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.472209 26865 ts_tablet_manager.cc:1434] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:28.472380 26865 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap starting.
I20251214 21:04:28.472589 26863 ts_tablet_manager.cc:1403] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251214 21:04:28.472980 26863 raft_consensus.cc:359] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.473062 26863 raft_consensus.cc:385] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.473091 26863 raft_consensus.cc:740] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.473206 26863 consensus_queue.cc:260] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.473270 26865 tablet_bootstrap.cc:654] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.473541 26863 ts_tablet_manager.cc:1434] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:28.473690 26863 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap starting.
I20251214 21:04:28.474653 26863 tablet_bootstrap.cc:654] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.474720 26864 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap starting.
I20251214 21:04:28.475623 26864 tablet_bootstrap.cc:654] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.476300 26865 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: No bootstrap required, opened a new log
I20251214 21:04:28.476388 26865 ts_tablet_manager.cc:1403] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251214 21:04:28.476737 26865 raft_consensus.cc:359] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.476819 26865 raft_consensus.cc:385] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.476848 26865 raft_consensus.cc:740] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.476961 26865 consensus_queue.cc:260] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.477171 26865 ts_tablet_manager.cc:1434] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:28.477322 26865 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap starting.
I20251214 21:04:28.478251 26865 tablet_bootstrap.cc:654] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.478331 26863 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: No bootstrap required, opened a new log
I20251214 21:04:28.478405 26863 ts_tablet_manager.cc:1403] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20251214 21:04:28.478906 26863 raft_consensus.cc:359] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.479005 26863 raft_consensus.cc:385] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.479027 26863 raft_consensus.cc:740] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.479128 26863 consensus_queue.cc:260] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.479326 26863 ts_tablet_manager.cc:1434] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:28.479691 26863 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap starting.
I20251214 21:04:28.480093 26865 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: No bootstrap required, opened a new log
I20251214 21:04:28.480188 26865 ts_tablet_manager.cc:1403] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251214 21:04:28.480621 26863 tablet_bootstrap.cc:654] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.480597 26865 raft_consensus.cc:359] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.480723 26865 raft_consensus.cc:385] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.480778 26865 raft_consensus.cc:740] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.481019 26865 consensus_queue.cc:260] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.481734 26865 ts_tablet_manager.cc:1434] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:28.481873 26864 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: No bootstrap required, opened a new log
I20251214 21:04:28.481961 26865 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap starting.
I20251214 21:04:28.482035 26863 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: No bootstrap required, opened a new log
I20251214 21:04:28.482066 26864 ts_tablet_manager.cc:1403] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251214 21:04:28.482097 26863 ts_tablet_manager.cc:1403] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251214 21:04:28.482542 26864 raft_consensus.cc:359] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.482636 26864 raft_consensus.cc:385] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.482668 26863 raft_consensus.cc:359] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.482669 26864 raft_consensus.cc:740] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.482797 26863 raft_consensus.cc:385] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.482831 26863 raft_consensus.cc:740] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.482889 26864 consensus_queue.cc:260] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.482939 26863 consensus_queue.cc:260] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.483134 26864 ts_tablet_manager.cc:1434] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:28.483187 26863 ts_tablet_manager.cc:1434] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:28.483321 26864 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap starting.
I20251214 21:04:28.483371 26863 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap starting.
I20251214 21:04:28.483628 26865 tablet_bootstrap.cc:654] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.484215 26864 tablet_bootstrap.cc:654] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.484287 26863 tablet_bootstrap.cc:654] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.484922 26865 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: No bootstrap required, opened a new log
I20251214 21:04:28.484992 26865 ts_tablet_manager.cc:1403] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:28.485258 26864 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: No bootstrap required, opened a new log
I20251214 21:04:28.485350 26864 ts_tablet_manager.cc:1403] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:28.485371 26865 raft_consensus.cc:359] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.485473 26865 raft_consensus.cc:385] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.485543 26865 raft_consensus.cc:740] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.485687 26865 consensus_queue.cc:260] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.486065 26865 ts_tablet_manager.cc:1434] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:28.486645 26863 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: No bootstrap required, opened a new log
I20251214 21:04:28.486722 26863 ts_tablet_manager.cc:1403] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20251214 21:04:28.487089 26863 raft_consensus.cc:359] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.487104 26864 raft_consensus.cc:359] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.487222 26863 raft_consensus.cc:385] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.487275 26864 raft_consensus.cc:385] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.487310 26863 raft_consensus.cc:740] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.487349 26864 raft_consensus.cc:740] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.487437 26863 consensus_queue.cc:260] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.487493 26864 consensus_queue.cc:260] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.487772 26864 ts_tablet_manager.cc:1434] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:28.487807 26863 ts_tablet_manager.cc:1434] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:28.487969 26864 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap starting.
I20251214 21:04:28.489001 26864 tablet_bootstrap.cc:654] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:28.490105 26864 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: No bootstrap required, opened a new log
I20251214 21:04:28.490195 26864 ts_tablet_manager.cc:1403] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:28.490621 26864 raft_consensus.cc:359] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.490725 26864 raft_consensus.cc:385] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:28.490764 26864 raft_consensus.cc:740] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Initialized, Role: FOLLOWER
I20251214 21:04:28.490873 26864 consensus_queue.cc:260] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.491101 26864 ts_tablet_manager.cc:1434] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:28.517655 26871 raft_consensus.cc:493] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:28.517819 26871 raft_consensus.cc:515] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.518334 26871 leader_election.cc:290] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565), 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:28.522539 26742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:28.522542 26817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d8e47dbd69466dbfa4256b374f3375" is_pre_election: true
I20251214 21:04:28.522680 26742 raft_consensus.cc:2468] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6197c79bf5a44cf9c5ffd0767267463 in term 0.
I20251214 21:04:28.522730 26817 raft_consensus.cc:2468] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6197c79bf5a44cf9c5ffd0767267463 in term 0.
I20251214 21:04:28.522950 26631 leader_election.cc:304] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6197c79bf5a44cf9c5ffd0767267463, ef4aa669b37244a4af7b55f17c99ae80; no voters:
I20251214 21:04:28.523101 26871 raft_consensus.cc:2804] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:28.523157 26871 raft_consensus.cc:493] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:28.523183 26871 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.523976 26871 raft_consensus.cc:515] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.524256 26871 leader_election.cc:290] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 1 election: Requested vote from peers ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565), 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:28.524539 26817 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d8e47dbd69466dbfa4256b374f3375"
I20251214 21:04:28.524539 26742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:28.524657 26817 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.524667 26742 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.525604 26817 raft_consensus.cc:2468] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6197c79bf5a44cf9c5ffd0767267463 in term 1.
I20251214 21:04:28.525763 26742 raft_consensus.cc:2468] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6197c79bf5a44cf9c5ffd0767267463 in term 1.
I20251214 21:04:28.525856 26632 leader_election.cc:304] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, b6197c79bf5a44cf9c5ffd0767267463; no voters:
I20251214 21:04:28.526005 26871 raft_consensus.cc:2804] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:28.526204 26871 raft_consensus.cc:697] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 LEADER]: Becoming Leader. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Running, Role: LEADER
I20251214 21:04:28.526333 26871 consensus_queue.cc:237] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.527698 26563 catalog_manager.cc:5654] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1). New cstate: current_term: 1 leader_uuid: "b6197c79bf5a44cf9c5ffd0767267463" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:28.604665 26693 tablet.cc:2378] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:28.619446 26870 raft_consensus.cc:493] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:28.619594 26870 raft_consensus.cc:515] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.620082 26870 leader_election.cc:290] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:28.623347 26742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5422d839d405479cb53a4e442395b4cf" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:28.623395 26666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5422d839d405479cb53a4e442395b4cf" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463" is_pre_election: true
I20251214 21:04:28.623490 26742 raft_consensus.cc:2468] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 0.
I20251214 21:04:28.623528 26666 raft_consensus.cc:2468] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 0.
I20251214 21:04:28.623776 26782 leader_election.cc:304] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, ef4aa669b37244a4af7b55f17c99ae80; no voters:
I20251214 21:04:28.623943 26870 raft_consensus.cc:2804] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:28.624008 26870 raft_consensus.cc:493] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:28.624053 26870 raft_consensus.cc:3060] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.624900 26870 raft_consensus.cc:515] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.625238 26870 leader_election.cc:290] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 election: Requested vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:28.625556 26666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5422d839d405479cb53a4e442395b4cf" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463"
I20251214 21:04:28.625664 26666 raft_consensus.cc:3060] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.626505 26666 raft_consensus.cc:2468] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:28.626693 26742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5422d839d405479cb53a4e442395b4cf" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:28.626771 26742 raft_consensus.cc:3060] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.626785 26780 leader_election.cc:304] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, b6197c79bf5a44cf9c5ffd0767267463; no voters:
I20251214 21:04:28.626948 26870 raft_consensus.cc:2804] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:28.627156 26870 raft_consensus.cc:697] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: Becoming Leader. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Running, Role: LEADER
I20251214 21:04:28.627302 26870 consensus_queue.cc:237] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.627672 26742 raft_consensus.cc:2468] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:28.628926 26563 catalog_manager.cc:5654] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:28.686179 26887 raft_consensus.cc:493] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:28.686369 26887 raft_consensus.cc:515] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.686800 26887 leader_election.cc:290] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:28.687301 26666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463" is_pre_election: true
I20251214 21:04:28.687301 26742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:28.687464 26742 raft_consensus.cc:2468] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 0.
I20251214 21:04:28.687464 26666 raft_consensus.cc:2468] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 0.
I20251214 21:04:28.687764 26780 leader_election.cc:304] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, b6197c79bf5a44cf9c5ffd0767267463; no voters:
I20251214 21:04:28.687932 26887 raft_consensus.cc:2804] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:28.687996 26887 raft_consensus.cc:493] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:28.688027 26887 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.688931 26887 raft_consensus.cc:515] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.689339 26887 leader_election.cc:290] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 election: Requested vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:28.689657 26742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:28.689657 26666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463"
I20251214 21:04:28.689800 26742 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.689815 26666 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.690555 26742 raft_consensus.cc:2468] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:28.690559 26666 raft_consensus.cc:2468] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:28.690827 26780 leader_election.cc:304] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, b6197c79bf5a44cf9c5ffd0767267463, ef4aa669b37244a4af7b55f17c99ae80; no voters:
I20251214 21:04:28.690992 26887 raft_consensus.cc:2804] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:28.691071 26887 raft_consensus.cc:697] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: Becoming Leader. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Running, Role: LEADER
I20251214 21:04:28.691195 26887 consensus_queue.cc:237] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.692726 26563 catalog_manager.cc:5654] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:28.777096 26887 raft_consensus.cc:493] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:28.777258 26887 raft_consensus.cc:515] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.777678 26887 leader_election.cc:290] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:28.778167 26742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:28.778189 26666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463" is_pre_election: true
I20251214 21:04:28.778285 26742 raft_consensus.cc:2468] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 0.
I20251214 21:04:28.778326 26666 raft_consensus.cc:2468] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 0.
I20251214 21:04:28.778542 26782 leader_election.cc:304] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, ef4aa669b37244a4af7b55f17c99ae80; no voters:
I20251214 21:04:28.778717 26887 raft_consensus.cc:2804] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:28.778769 26887 raft_consensus.cc:493] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:28.778801 26887 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.779623 26887 raft_consensus.cc:515] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.779950 26887 leader_election.cc:290] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 election: Requested vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:28.780264 26666 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463"
I20251214 21:04:28.780315 26742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:28.780400 26666 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.780407 26742 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:28.781111 26742 raft_consensus.cc:2468] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:28.781164 26666 raft_consensus.cc:2468] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:28.781351 26782 leader_election.cc:304] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, ef4aa669b37244a4af7b55f17c99ae80; no voters:
I20251214 21:04:28.781499 26887 raft_consensus.cc:2804] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:28.781580 26887 raft_consensus.cc:697] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: Becoming Leader. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Running, Role: LEADER
I20251214 21:04:28.781734 26887 consensus_queue.cc:237] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:28.783339 26563 catalog_manager.cc:5654] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:28.824112 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:04:28.827558 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:28.827868 20608 tablet_replica.cc:333] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: stopping tablet replica
I20251214 21:04:28.827993 20608 raft_consensus.cc:2243] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:28.828153 20608 pending_rounds.cc:70] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Trying to abort 1 pending ops.
I20251214 21:04:28.828189 20608 pending_rounds.cc:77] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496715885203456 op_type: NO_OP noop_request { }
I20251214 21:04:28.828250 20608 raft_consensus.cc:2889] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:28.828294 20608 raft_consensus.cc:2272] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.828903 20608 tablet_replica.cc:333] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: stopping tablet replica
I20251214 21:04:28.828990 20608 raft_consensus.cc:2243] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:28.829066 20608 raft_consensus.cc:2272] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.829382 20608 tablet_replica.cc:333] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: stopping tablet replica
I20251214 21:04:28.829455 20608 raft_consensus.cc:2243] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:28.829520 20608 raft_consensus.cc:2272] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.829871 20608 tablet_replica.cc:333] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: stopping tablet replica
I20251214 21:04:28.829939 20608 raft_consensus.cc:2243] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:28.829999 20608 raft_consensus.cc:2272] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.832870 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:04:28.835028 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:04:28.838863 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:28.839193 20608 tablet_replica.cc:333] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: stopping tablet replica
I20251214 21:04:28.839336 20608 raft_consensus.cc:2243] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:28.839471 20608 raft_consensus.cc:2272] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.840001 20608 tablet_replica.cc:333] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: stopping tablet replica
I20251214 21:04:28.840088 20608 raft_consensus.cc:2243] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:28.840162 20608 raft_consensus.cc:2272] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.840538 20608 tablet_replica.cc:333] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: stopping tablet replica
I20251214 21:04:28.840611 20608 raft_consensus.cc:2243] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:28.840677 20608 raft_consensus.cc:2272] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.840991 20608 tablet_replica.cc:333] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: stopping tablet replica
I20251214 21:04:28.841058 20608 raft_consensus.cc:2243] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:28.841120 20608 raft_consensus.cc:2272] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.854148 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:04:28.856500 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:04:28.860059 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:28.860325 20608 tablet_replica.cc:333] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: stopping tablet replica
I20251214 21:04:28.860468 20608 raft_consensus.cc:2243] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:28.860592 20608 raft_consensus.cc:2272] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.861096 20608 tablet_replica.cc:333] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: stopping tablet replica
I20251214 21:04:28.861281 20608 raft_consensus.cc:2243] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:28.861552 20608 pending_rounds.cc:70] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Trying to abort 1 pending ops.
I20251214 21:04:28.861589 20608 pending_rounds.cc:77] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496716299026432 op_type: NO_OP noop_request { }
I20251214 21:04:28.861670 20608 raft_consensus.cc:2889] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:28.861763 20608 raft_consensus.cc:2272] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.862464 20608 tablet_replica.cc:333] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: stopping tablet replica
I20251214 21:04:28.862555 20608 raft_consensus.cc:2243] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:28.862674 20608 pending_rounds.cc:70] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Trying to abort 1 pending ops.
I20251214 21:04:28.862702 20608 pending_rounds.cc:77] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496716931485696 op_type: NO_OP noop_request { }
I20251214 21:04:28.862761 20608 raft_consensus.cc:2889] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:28.862816 20608 raft_consensus.cc:2272] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.863309 20608 tablet_replica.cc:333] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: stopping tablet replica
I20251214 21:04:28.863396 20608 raft_consensus.cc:2243] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:28.863505 20608 pending_rounds.cc:70] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Trying to abort 1 pending ops.
I20251214 21:04:28.863531 20608 pending_rounds.cc:77] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496716560637952 op_type: NO_OP noop_request { }
I20251214 21:04:28.863584 20608 raft_consensus.cc:2889] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:28.863636 20608 raft_consensus.cc:2272] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:28.877099 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:04:28.879647 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:28.881359 26891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:28.881459 26892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:28.881515 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:28.881500 26894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:28.881801 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:28.881850 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:28.881871 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746268881871 us; error 0 us; skew 500 ppm
I20251214 21:04:28.882640 20608 webserver.cc:492] Webserver started at http://127.20.32.4:46209/ using document root <none> and password file <none>
I20251214 21:04:28.882777 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:28.882831 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:28.882907 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:28.883284 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-3-root/instance:
uuid: "a23e1afc23e84bd98dd37a147eac6369"
format_stamp: "Formatted at 2025-12-14 21:04:28 on dist-test-slave-bphs"
I20251214 21:04:28.884684 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:04:28.885601 26899 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:28.885936 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:28.886003 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-3-root
uuid: "a23e1afc23e84bd98dd37a147eac6369"
format_stamp: "Formatted at 2025-12-14 21:04:28 on dist-test-slave-bphs"
I20251214 21:04:28.886067 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:28.895151 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:28.895499 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:28.895749 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:28.896203 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:28.896247 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:28.896292 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:28.896325 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:28.900087 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.4:37393
I20251214 21:04:28.901304 26962 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.4:37393 every 8 connection(s)
I20251214 21:04:28.906152 26963 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42757
I20251214 21:04:28.906286 26963 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:28.906520 26963 heartbeater.cc:507] Master 127.20.32.62:42757 requested a full tablet report, sending...
I20251214 21:04:28.907121 26563 ts_manager.cc:194] Registered new tserver with Master: a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4:37393)
I20251214 21:04:28.907642 26563 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56850
W20251214 21:04:29.294960 26612 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:29.296296 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:29.296371 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:29.297317 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:29.297382 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:29.298282 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:29.298344 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
I20251214 21:04:29.908524 26963 heartbeater.cc:499] Master 127.20.32.62:42757 was elected leader, sending a full tablet report...
W20251214 21:04:30.300820 26612 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:30.301623 26547 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20251214 21:04:30.302414 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:30.302464 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:30.303419 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:30.303473 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:30.304359 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:30.304411 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:31.306949 26612 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:31.308461 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:31.308527 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:31.309733 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:31.309803 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:31.310781 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:31.310830 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:32.313409 26612 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:32.314949 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:32.315022 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:32.316154 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:32.316228 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:32.317375 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:32.317440 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:33.319958 26612 auto_rebalancer.cc:253] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:33.321349 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:33.321408 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:33.322434 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:33.322504 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.3:33147: connect: Connection refused (error 111)
W20251214 21:04:33.323537 26612 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:33.323598 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.20.32.1:33051: connect: Connection refused (error 111)
W20251214 21:04:34.324190 26612 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver b6197c79bf5a44cf9c5ffd0767267463 not available for placement
I20251214 21:04:34.414994 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:04:34.416981 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:34.416975 26984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:34.417107 26981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:34.417178 26982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:34.417418 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:34.417464 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:34.417477 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746274417477 us; error 0 us; skew 500 ppm
I20251214 21:04:34.418443 20608 webserver.cc:492] Webserver started at http://127.20.32.1:38379/ using document root <none> and password file <none>
I20251214 21:04:34.418596 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:34.418632 20608 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251214 21:04:34.419653 20608 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:34.420585 26989 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:34.420850 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:34.420920 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "b6197c79bf5a44cf9c5ffd0767267463"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:34.420997 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:34.427660 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:34.427969 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:34.428220 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:34.428917 26996 ts_tablet_manager.cc:542] Loading tablet metadata (0/4 complete)
I20251214 21:04:34.432063 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (4 total tablets, 4 live tablets)
I20251214 21:04:34.432116 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20251214 21:04:34.432154 20608 ts_tablet_manager.cc:600] Registering tablets (0/4 complete)
I20251214 21:04:34.432920 26996 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap starting.
I20251214 21:04:34.434651 20608 ts_tablet_manager.cc:616] Registered 4 tablets
I20251214 21:04:34.434707 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:34.435500 26996 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:34.435750 26996 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap complete.
I20251214 21:04:34.435936 26996 ts_tablet_manager.cc:1403] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:34.436371 26996 raft_consensus.cc:359] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.436494 26996 raft_consensus.cc:740] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.436709 26996 consensus_queue.cc:260] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.437052 26996 ts_tablet_manager.cc:1434] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:34.437232 26996 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap starting.
I20251214 21:04:34.439643 26996 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:34.439774 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:33051
I20251214 21:04:34.439816 27056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:33051 every 8 connection(s)
I20251214 21:04:34.439858 26996 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap complete.
I20251214 21:04:34.440012 26996 ts_tablet_manager.cc:1403] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:34.440435 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:04:34.440390 26996 raft_consensus.cc:359] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.440505 26996 raft_consensus.cc:740] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.440629 26996 consensus_queue.cc:260] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.440877 26996 ts_tablet_manager.cc:1434] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:34.441028 26996 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap starting.
W20251214 21:04:34.442960 27061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:34.443382 27064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:34.443473 27062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:34.443673 20608 server_base.cc:1047] running on GCE node
I20251214 21:04:34.443790 26996 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:34.443821 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:34.443857 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:34.443877 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746274443876 us; error 0 us; skew 500 ppm
I20251214 21:04:34.444042 26996 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap complete.
I20251214 21:04:34.444185 26996 ts_tablet_manager.cc:1403] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251214 21:04:34.444586 26996 raft_consensus.cc:359] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.444690 26996 raft_consensus.cc:740] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.444809 26996 consensus_queue.cc:260] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.444847 20608 webserver.cc:492] Webserver started at http://127.20.32.2:44843/ using document root <none> and password file <none>
I20251214 21:04:34.445001 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:34.445027 20608 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251214 21:04:34.445081 26996 ts_tablet_manager.cc:1434] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:34.445226 26996 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap starting.
I20251214 21:04:34.445924 20608 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:34.446823 27071 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:34.447077 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:34.447136 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "ef4aa669b37244a4af7b55f17c99ae80"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:34.447196 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:34.447525 26996 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251214 21:04:34.447866 26996 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Bootstrap complete.
I20251214 21:04:34.448025 26996 ts_tablet_manager.cc:1403] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:04:34.448412 26996 raft_consensus.cc:359] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.448597 26996 raft_consensus.cc:740] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.448745 26996 consensus_queue.cc:260] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.449003 26996 ts_tablet_manager.cc:1434] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:34.449193 27057 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42757
I20251214 21:04:34.449273 27057 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:34.449467 27057 heartbeater.cc:507] Master 127.20.32.62:42757 requested a full tablet report, sending...
I20251214 21:04:34.450305 26563 ts_manager.cc:194] Re-registered known tserver with Master: b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051)
I20251214 21:04:34.451525 26563 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54666
I20251214 21:04:34.452167 27057 heartbeater.cc:499] Master 127.20.32.62:42757 was elected leader, sending a full tablet report...
I20251214 21:04:34.478782 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:34.479205 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:34.479483 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:34.483199 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (4 total tablets, 4 live tablets)
I20251214 21:04:34.483273 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20251214 21:04:34.484126 27078 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap starting.
I20251214 21:04:34.485297 20608 ts_tablet_manager.cc:616] Registered 4 tablets
I20251214 21:04:34.485344 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251214 21:04:34.486519 27078 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:34.486795 27078 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap complete.
I20251214 21:04:34.486979 27078 ts_tablet_manager.cc:1403] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:34.487368 27078 raft_consensus.cc:359] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.487468 27078 raft_consensus.cc:740] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.487629 27078 consensus_queue.cc:260] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.488024 27078 ts_tablet_manager.cc:1434] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:34.488184 27078 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap starting.
I20251214 21:04:34.490334 27078 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:34.490542 27078 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap complete.
I20251214 21:04:34.490571 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:45565
I20251214 21:04:34.490623 27138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:45565 every 8 connection(s)
I20251214 21:04:34.490712 27078 ts_tablet_manager.cc:1403] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:34.491102 27078 raft_consensus.cc:359] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.491218 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:04:34.491242 27078 raft_consensus.cc:740] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.491510 27078 consensus_queue.cc:260] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.491804 27078 ts_tablet_manager.cc:1434] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:34.491990 27078 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap starting.
W20251214 21:04:34.493376 27142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:34.493618 27145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:34.494058 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:34.494414 27143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:34.494782 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:34.494835 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:34.494858 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746274494858 us; error 0 us; skew 500 ppm
I20251214 21:04:34.495033 27078 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:34.495256 27078 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap complete.
I20251214 21:04:34.495430 27078 ts_tablet_manager.cc:1403] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:34.495754 27139 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42757
I20251214 21:04:34.495812 20608 webserver.cc:492] Webserver started at http://127.20.32.3:37747/ using document root <none> and password file <none>
I20251214 21:04:34.495851 27139 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:34.495949 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:34.495893 27078 raft_consensus.cc:359] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.495973 20608 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251214 21:04:34.496008 27078 raft_consensus.cc:740] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.496090 27139 heartbeater.cc:507] Master 127.20.32.62:42757 requested a full tablet report, sending...
I20251214 21:04:34.496136 27078 consensus_queue.cc:260] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.496392 27078 ts_tablet_manager.cc:1434] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:34.496565 27078 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap starting.
I20251214 21:04:34.497007 20608 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:34.497071 26563 ts_manager.cc:194] Re-registered known tserver with Master: ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:34.498212 27151 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:34.498354 26563 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54668
I20251214 21:04:34.498466 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:34.498512 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "28d8e47dbd69466dbfa4256b374f3375"
format_stamp: "Formatted at 2025-12-14 21:04:27 on dist-test-slave-bphs"
I20251214 21:04:34.498559 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestHandlingFailedTservers.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:34.498929 27078 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:34.499181 27139 heartbeater.cc:499] Master 127.20.32.62:42757 was elected leader, sending a full tablet report...
I20251214 21:04:34.499188 27078 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Bootstrap complete.
I20251214 21:04:34.499413 27078 ts_tablet_manager.cc:1403] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:34.499826 27078 raft_consensus.cc:359] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.499933 27078 raft_consensus.cc:740] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.500036 27078 consensus_queue.cc:260] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.500260 27078 ts_tablet_manager.cc:1434] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:34.512961 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:34.513396 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:34.513676 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:34.517432 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (4 total tablets, 4 live tablets)
I20251214 21:04:34.517508 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20251214 21:04:34.518358 27159 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap starting.
I20251214 21:04:34.519521 20608 ts_tablet_manager.cc:616] Registered 4 tablets
I20251214 21:04:34.519570 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251214 21:04:34.521569 27159 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251214 21:04:34.521942 27159 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap complete.
I20251214 21:04:34.522133 27159 ts_tablet_manager.cc:1403] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20251214 21:04:34.522682 27159 raft_consensus.cc:359] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.522856 27159 raft_consensus.cc:740] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.523022 27159 consensus_queue.cc:260] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.523358 27159 ts_tablet_manager.cc:1434] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:34.523550 27159 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap starting.
I20251214 21:04:34.525326 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:33147
I20251214 21:04:34.525362 27218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:33147 every 8 connection(s)
I20251214 21:04:34.526714 27159 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251214 21:04:34.527038 27159 tablet_bootstrap.cc:492] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap complete.
I20251214 21:04:34.527213 27159 ts_tablet_manager.cc:1403] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251214 21:04:34.527640 27159 raft_consensus.cc:359] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.527818 27159 raft_consensus.cc:740] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.527961 27159 consensus_queue.cc:260] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.528311 27159 ts_tablet_manager.cc:1434] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251214 21:04:34.528501 27159 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap starting.
I20251214 21:04:34.530215 27219 heartbeater.cc:344] Connected to a master server at 127.20.32.62:42757
I20251214 21:04:34.530334 27219 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:34.530591 27219 heartbeater.cc:507] Master 127.20.32.62:42757 requested a full tablet report, sending...
I20251214 21:04:34.531435 26563 ts_manager.cc:194] Re-registered known tserver with Master: 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:34.531494 27159 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251214 21:04:34.531733 27159 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap complete.
I20251214 21:04:34.531881 27159 ts_tablet_manager.cc:1403] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:34.532262 27159 raft_consensus.cc:359] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.532389 27159 raft_consensus.cc:740] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.532526 27159 consensus_queue.cc:260] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.532527 26563 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54672
I20251214 21:04:34.532764 27159 ts_tablet_manager.cc:1434] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:34.532941 27159 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap starting.
I20251214 21:04:34.533320 27219 heartbeater.cc:499] Master 127.20.32.62:42757 was elected leader, sending a full tablet report...
I20251214 21:04:34.535288 27159 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:34.535491 27159 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Bootstrap complete.
I20251214 21:04:34.535650 27159 ts_tablet_manager.cc:1403] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:34.536031 27159 raft_consensus.cc:359] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.536131 27159 raft_consensus.cc:740] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Initialized, Role: FOLLOWER
I20251214 21:04:34.536243 27159 consensus_queue.cc:260] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:34.536484 27159 ts_tablet_manager.cc:1434] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20251214 21:04:35.330549 26612 auto_rebalancer.cc:253] failed to send replica move request: Illegal state: Replica b6197c79bf5a44cf9c5ffd0767267463 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } }
W20251214 21:04:35.331619 26612 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 61deee6d8e6b4dc39389a5b3662a98c0, TS 28d8e47dbd69466dbfa4256b374f3375 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:35.331681 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 61deee6d8e6b4dc39389a5b3662a98c0, TS 28d8e47dbd69466dbfa4256b374f3375 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:35.335417 26612 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 2e7ecef437b54cb0b0c4cf5ff4e55799, TS b6197c79bf5a44cf9c5ffd0767267463 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:35.335489 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 2e7ecef437b54cb0b0c4cf5ff4e55799, TS b6197c79bf5a44cf9c5ffd0767267463 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:35.336174 26612 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f30ac5dafe604761b15603b2c748ad26, TS ef4aa669b37244a4af7b55f17c99ae80 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:35.336225 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet f30ac5dafe604761b15603b2c748ad26, TS ef4aa669b37244a4af7b55f17c99ae80 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.633898 27228 raft_consensus.cc:493] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:35.634053 27228 raft_consensus.cc:515] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.634621 27228 leader_election.cc:290] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565), 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:35.637970 27192 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d8e47dbd69466dbfa4256b374f3375" is_pre_election: true
I20251214 21:04:35.638065 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:35.638149 27192 raft_consensus.cc:2410] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6197c79bf5a44cf9c5ffd0767267463 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:35.638200 27112 raft_consensus.cc:2468] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6197c79bf5a44cf9c5ffd0767267463 in term 1.
I20251214 21:04:35.638487 26992 leader_election.cc:304] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6197c79bf5a44cf9c5ffd0767267463, ef4aa669b37244a4af7b55f17c99ae80; no voters: 28d8e47dbd69466dbfa4256b374f3375
I20251214 21:04:35.638667 27228 raft_consensus.cc:2804] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:35.638729 27228 raft_consensus.cc:493] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:35.638775 27228 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:35.639671 27228 raft_consensus.cc:515] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.639998 27228 leader_election.cc:290] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 2 election: Requested vote from peers ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565), 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:35.640314 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:35.640316 27192 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d8e47dbd69466dbfa4256b374f3375"
I20251214 21:04:35.640429 27112 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:35.640437 27192 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:35.641295 27112 raft_consensus.cc:2468] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6197c79bf5a44cf9c5ffd0767267463 in term 2.
I20251214 21:04:35.641314 27192 raft_consensus.cc:2410] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b6197c79bf5a44cf9c5ffd0767267463 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:35.641731 26992 leader_election.cc:304] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6197c79bf5a44cf9c5ffd0767267463, ef4aa669b37244a4af7b55f17c99ae80; no voters: 28d8e47dbd69466dbfa4256b374f3375
I20251214 21:04:35.641906 27228 raft_consensus.cc:2804] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:35.642099 27228 raft_consensus.cc:697] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 LEADER]: Becoming Leader. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Running, Role: LEADER
I20251214 21:04:35.642345 27228 consensus_queue.cc:237] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.643929 26563 catalog_manager.cc:5654] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 reported cstate change: term changed from 1 to 2, leader changed from 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3) to b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1). New cstate: current_term: 2 leader_uuid: "b6197c79bf5a44cf9c5ffd0767267463" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:35.731494 27238 raft_consensus.cc:493] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:35.731648 27238 raft_consensus.cc:515] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.732240 27238 leader_election.cc:290] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:35.735562 27192 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "ef4aa669b37244a4af7b55f17c99ae80" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d8e47dbd69466dbfa4256b374f3375" is_pre_election: true
I20251214 21:04:35.735723 27192 raft_consensus.cc:2410] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef4aa669b37244a4af7b55f17c99ae80 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:35.735663 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "ef4aa669b37244a4af7b55f17c99ae80" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463" is_pre_election: true
I20251214 21:04:35.735831 27025 raft_consensus.cc:2468] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef4aa669b37244a4af7b55f17c99ae80 in term 1.
I20251214 21:04:35.736300 27072 leader_election.cc:304] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6197c79bf5a44cf9c5ffd0767267463, ef4aa669b37244a4af7b55f17c99ae80; no voters: 28d8e47dbd69466dbfa4256b374f3375
I20251214 21:04:35.736497 27238 raft_consensus.cc:2804] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:35.736562 27238 raft_consensus.cc:493] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:35.736596 27238 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:35.737444 27238 raft_consensus.cc:515] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.737843 27238 leader_election.cc:290] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [CANDIDATE]: Term 2 election: Requested vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:35.738145 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "ef4aa669b37244a4af7b55f17c99ae80" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463"
I20251214 21:04:35.738183 27192 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "ef4aa669b37244a4af7b55f17c99ae80" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d8e47dbd69466dbfa4256b374f3375"
I20251214 21:04:35.738266 27025 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:35.738265 27192 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:35.739454 27025 raft_consensus.cc:2468] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef4aa669b37244a4af7b55f17c99ae80 in term 2.
I20251214 21:04:35.739506 27192 raft_consensus.cc:2410] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef4aa669b37244a4af7b55f17c99ae80 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:35.739773 27072 leader_election.cc:304] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6197c79bf5a44cf9c5ffd0767267463, ef4aa669b37244a4af7b55f17c99ae80; no voters:
I20251214 21:04:35.739944 27238 raft_consensus.cc:2804] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:35.740159 27238 raft_consensus.cc:697] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 LEADER]: Becoming Leader. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Running, Role: LEADER
I20251214 21:04:35.740289 27238 consensus_queue.cc:237] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.741791 26563 catalog_manager.cc:5654] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 reported cstate change: term changed from 1 to 2, leader changed from 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3) to ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2). New cstate: current_term: 2 leader_uuid: "ef4aa669b37244a4af7b55f17c99ae80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:35.747529 27243 raft_consensus.cc:493] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:35.747649 27243 raft_consensus.cc:515] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.748198 27243 leader_election.cc:290] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:35.751513 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:35.751801 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463" is_pre_election: true
I20251214 21:04:35.751924 27025 raft_consensus.cc:2468] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 2.
I20251214 21:04:35.752184 27153 leader_election.cc:304] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, b6197c79bf5a44cf9c5ffd0767267463; no voters: ef4aa669b37244a4af7b55f17c99ae80
I20251214 21:04:35.752354 27243 raft_consensus.cc:2804] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251214 21:04:35.752414 27243 raft_consensus.cc:493] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:35.752460 27243 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:35.753413 27243 raft_consensus.cc:515] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.753814 27243 leader_election.cc:290] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 3 election: Requested vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:35.754091 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:35.754092 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e7ecef437b54cb0b0c4cf5ff4e55799" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463"
I20251214 21:04:35.754233 27025 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:35.755050 27025 raft_consensus.cc:2468] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 3.
I20251214 21:04:35.755344 27153 leader_election.cc:304] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, b6197c79bf5a44cf9c5ffd0767267463; no voters: ef4aa669b37244a4af7b55f17c99ae80
I20251214 21:04:35.755528 27243 raft_consensus.cc:2804] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:04:35.755733 27243 raft_consensus.cc:697] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 LEADER]: Becoming Leader. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Running, Role: LEADER
I20251214 21:04:35.755860 27243 consensus_queue.cc:237] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.757298 26563 catalog_manager.cc:5654] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 reported cstate change: term changed from 2 to 3, leader changed from ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2) to 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3). New cstate: current_term: 3 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:35.982861 27243 raft_consensus.cc:493] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:35.983042 27243 raft_consensus.cc:515] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.983492 27243 leader_election.cc:290] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:35.983925 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:35.983925 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463" is_pre_election: true
I20251214 21:04:35.984086 27112 raft_consensus.cc:2468] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 2.
I20251214 21:04:35.984452 27155 leader_election.cc:304] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, ef4aa669b37244a4af7b55f17c99ae80; no voters: b6197c79bf5a44cf9c5ffd0767267463
I20251214 21:04:35.984671 27243 raft_consensus.cc:2804] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251214 21:04:35.984733 27243 raft_consensus.cc:493] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:35.984762 27243 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:35.985632 27243 raft_consensus.cc:515] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.986001 27243 leader_election.cc:290] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 3 election: Requested vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:35.986320 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:35.986317 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f30ac5dafe604761b15603b2c748ad26" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463"
I20251214 21:04:35.986452 27112 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:35.987278 27112 raft_consensus.cc:2468] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 3.
I20251214 21:04:35.987536 27155 leader_election.cc:304] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, ef4aa669b37244a4af7b55f17c99ae80; no voters: b6197c79bf5a44cf9c5ffd0767267463
I20251214 21:04:35.987717 27243 raft_consensus.cc:2804] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:04:35.987813 27243 raft_consensus.cc:697] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 LEADER]: Becoming Leader. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Running, Role: LEADER
I20251214 21:04:35.987944 27243 consensus_queue.cc:237] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:35.989367 26563 catalog_manager.cc:5654] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 reported cstate change: term changed from 2 to 3, leader changed from b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1) to 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3). New cstate: current_term: 3 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:36.134915 27192 raft_consensus.cc:1240] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 LEADER]: Rejecting Update request from peer b6197c79bf5a44cf9c5ffd0767267463 for earlier term 2. Current term is 3. Ops: []
I20251214 21:04:36.135422 27228 consensus_queue.cc:1059] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.135612 27228 consensus_queue.cc:1243] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Peer 28d8e47dbd69466dbfa4256b374f3375 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251214 21:04:36.135701 27232 raft_consensus.cc:3055] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:04:36.135751 27232 raft_consensus.cc:740] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Running, Role: LEADER
I20251214 21:04:36.135900 27232 consensus_queue.cc:260] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.136040 27232 raft_consensus.cc:3060] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:36.162834 27243 raft_consensus.cc:493] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:36.162994 27243 raft_consensus.cc:515] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.163415 27243 leader_election.cc:290] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:36.163851 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5422d839d405479cb53a4e442395b4cf" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463" is_pre_election: true
I20251214 21:04:36.163852 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5422d839d405479cb53a4e442395b4cf" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:36.163980 27025 raft_consensus.cc:2468] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:36.163996 27112 raft_consensus.cc:2468] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:36.164248 27153 leader_election.cc:304] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, b6197c79bf5a44cf9c5ffd0767267463; no voters:
I20251214 21:04:36.164400 27243 raft_consensus.cc:2804] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:36.164461 27243 raft_consensus.cc:493] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:36.164489 27243 raft_consensus.cc:3060] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:36.165319 27243 raft_consensus.cc:515] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.165644 27243 leader_election.cc:290] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 2 election: Requested vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:36.165954 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5422d839d405479cb53a4e442395b4cf" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463"
I20251214 21:04:36.166025 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5422d839d405479cb53a4e442395b4cf" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:36.166065 27025 raft_consensus.cc:3060] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:36.166124 27112 raft_consensus.cc:3060] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:36.166834 27025 raft_consensus.cc:2468] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 2.
I20251214 21:04:36.166836 27112 raft_consensus.cc:2468] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 2.
I20251214 21:04:36.167128 27153 leader_election.cc:304] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, b6197c79bf5a44cf9c5ffd0767267463; no voters:
I20251214 21:04:36.167268 27243 raft_consensus.cc:2804] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:36.167347 27243 raft_consensus.cc:697] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 2 LEADER]: Becoming Leader. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Running, Role: LEADER
I20251214 21:04:36.167479 27243 consensus_queue.cc:237] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.168973 27243 raft_consensus.cc:493] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:36.168967 26563 catalog_manager.cc:5654] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:36.169085 27243 raft_consensus.cc:515] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.169384 27243 leader_election.cc:290] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:36.169631 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463" is_pre_election: true
I20251214 21:04:36.169790 27025 raft_consensus.cc:2410] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28d8e47dbd69466dbfa4256b374f3375 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:36.169832 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:36.169945 27112 raft_consensus.cc:2468] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 1.
I20251214 21:04:36.170142 27155 leader_election.cc:304] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, ef4aa669b37244a4af7b55f17c99ae80; no voters: b6197c79bf5a44cf9c5ffd0767267463
I20251214 21:04:36.170334 27243 raft_consensus.cc:2804] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:36.170397 27243 raft_consensus.cc:493] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:36.170440 27243 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:36.171402 27243 raft_consensus.cc:515] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.171682 27243 leader_election.cc:290] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 2 election: Requested vote from peers b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051), ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565)
I20251214 21:04:36.171921 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:36.172005 27112 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:36.172658 27112 raft_consensus.cc:2468] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28d8e47dbd69466dbfa4256b374f3375 in term 2.
I20251214 21:04:36.172844 27025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "28d8e47dbd69466dbfa4256b374f3375" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6197c79bf5a44cf9c5ffd0767267463"
I20251214 21:04:36.172940 27025 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:36.172923 27155 leader_election.cc:304] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d8e47dbd69466dbfa4256b374f3375, ef4aa669b37244a4af7b55f17c99ae80; no voters:
I20251214 21:04:36.173079 27243 raft_consensus.cc:2804] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:36.173182 27243 raft_consensus.cc:697] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 LEADER]: Becoming Leader. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Running, Role: LEADER
I20251214 21:04:36.173307 27243 consensus_queue.cc:237] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.173749 27025 raft_consensus.cc:2410] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 28d8e47dbd69466dbfa4256b374f3375 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:36.174656 26563 catalog_manager.cc:5654] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 reported cstate change: term changed from 1 to 2, leader changed from b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1) to 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3). New cstate: current_term: 2 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:36.323554 27232 raft_consensus.cc:493] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:36.323724 27232 raft_consensus.cc:515] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.324172 27232 leader_election.cc:290] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565), 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:36.324657 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80" is_pre_election: true
I20251214 21:04:36.324640 27192 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28d8e47dbd69466dbfa4256b374f3375" is_pre_election: true
I20251214 21:04:36.324812 27112 raft_consensus.cc:2468] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6197c79bf5a44cf9c5ffd0767267463 in term 2.
I20251214 21:04:36.325062 26992 leader_election.cc:304] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6197c79bf5a44cf9c5ffd0767267463, ef4aa669b37244a4af7b55f17c99ae80; no voters:
I20251214 21:04:36.325253 27232 raft_consensus.cc:2804] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251214 21:04:36.325311 27232 raft_consensus.cc:493] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:36.325343 27232 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:36.326371 27232 raft_consensus.cc:515] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.326779 27232 leader_election.cc:290] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 3 election: Requested vote from peers ef4aa669b37244a4af7b55f17c99ae80 (127.20.32.2:45565), 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:36.327126 27112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef4aa669b37244a4af7b55f17c99ae80"
I20251214 21:04:36.327168 27192 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61deee6d8e6b4dc39389a5b3662a98c0" candidate_uuid: "b6197c79bf5a44cf9c5ffd0767267463" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28d8e47dbd69466dbfa4256b374f3375"
I20251214 21:04:36.327224 27112 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:36.328094 27112 raft_consensus.cc:2468] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6197c79bf5a44cf9c5ffd0767267463 in term 3.
I20251214 21:04:36.328310 26992 leader_election.cc:304] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6197c79bf5a44cf9c5ffd0767267463, ef4aa669b37244a4af7b55f17c99ae80; no voters: 28d8e47dbd69466dbfa4256b374f3375
I20251214 21:04:36.328464 27232 raft_consensus.cc:2804] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:04:36.328581 27232 raft_consensus.cc:697] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 LEADER]: Becoming Leader. State: Replica: b6197c79bf5a44cf9c5ffd0767267463, State: Running, Role: LEADER
I20251214 21:04:36.328733 27232 consensus_queue.cc:237] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.330283 26563 catalog_manager.cc:5654] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 reported cstate change: term changed from 2 to 3, leader changed from 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3) to b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1). New cstate: current_term: 3 leader_uuid: "b6197c79bf5a44cf9c5ffd0767267463" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:36.338553 26612 auto_rebalancer.cc:253] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
W20251214 21:04:36.339576 26612 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 61deee6d8e6b4dc39389a5b3662a98c0, TS 28d8e47dbd69466dbfa4256b374f3375 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:36.339634 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 61deee6d8e6b4dc39389a5b3662a98c0, TS 28d8e47dbd69466dbfa4256b374f3375 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:36.340585 26612 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 2e7ecef437b54cb0b0c4cf5ff4e55799, TS b6197c79bf5a44cf9c5ffd0767267463 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:36.340647 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 2e7ecef437b54cb0b0c4cf5ff4e55799, TS b6197c79bf5a44cf9c5ffd0767267463 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:36.341542 26612 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f30ac5dafe604761b15603b2c748ad26, TS ef4aa669b37244a4af7b55f17c99ae80 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
W20251214 21:04:36.341612 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet f30ac5dafe604761b15603b2c748ad26, TS ef4aa669b37244a4af7b55f17c99ae80 -> TS a23e1afc23e84bd98dd37a147eac6369 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.351310 27025 raft_consensus.cc:1240] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Rejecting Update request from peer ef4aa669b37244a4af7b55f17c99ae80 for earlier term 2. Current term is 3. Ops: []
I20251214 21:04:36.351827 27252 consensus_queue.cc:1059] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.352077 27252 raft_consensus.cc:3055] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:04:36.352133 27252 raft_consensus.cc:740] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef4aa669b37244a4af7b55f17c99ae80, State: Running, Role: LEADER
I20251214 21:04:36.352278 27252 consensus_queue.cc:260] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.352449 27252 raft_consensus.cc:3060] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:36.353457 27112 raft_consensus.cc:1275] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251214 21:04:36.353950 27243 consensus_queue.cc:1048] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.354108 27243 consensus_queue.cc:1243] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Peer ef4aa669b37244a4af7b55f17c99ae80 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251214 21:04:36.354933 27112 pending_rounds.cc:85] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Aborting all ops after (but not including) 0
I20251214 21:04:36.354987 27112 pending_rounds.cc:107] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20251214 21:04:36.355017 27112 raft_consensus.cc:2889] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251214 21:04:36.356974 27025 raft_consensus.cc:1275] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251214 21:04:36.357409 27243 consensus_queue.cc:1048] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.374747 27025 raft_consensus.cc:1275] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251214 21:04:36.375406 27243 consensus_queue.cc:1048] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.375612 27243 consensus_queue.cc:1243] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Peer b6197c79bf5a44cf9c5ffd0767267463 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251214 21:04:36.376505 27025 pending_rounds.cc:85] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Aborting all ops after (but not including) 0
I20251214 21:04:36.376591 27025 pending_rounds.cc:107] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20251214 21:04:36.376626 27025 raft_consensus.cc:2889] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251214 21:04:36.378337 27112 raft_consensus.cc:1275] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251214 21:04:36.378764 27255 consensus_queue.cc:1048] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.552443 27112 raft_consensus.cc:1240] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Rejecting Update request from peer 28d8e47dbd69466dbfa4256b374f3375 for earlier term 2. Current term is 3. Ops: []
I20251214 21:04:36.552943 27255 consensus_queue.cc:1059] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.553120 27255 raft_consensus.cc:3055] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 LEADER]: Stepping down as leader of term 2
I20251214 21:04:36.553169 27255 raft_consensus.cc:740] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 28d8e47dbd69466dbfa4256b374f3375, State: Running, Role: LEADER
I20251214 21:04:36.553334 27255 consensus_queue.cc:260] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } }
I20251214 21:04:36.553498 27255 raft_consensus.cc:3060] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:36.559815 27112 raft_consensus.cc:1275] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251214 21:04:36.560252 27255 consensus_queue.cc:1048] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.563345 27025 raft_consensus.cc:1275] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251214 21:04:36.563687 27255 consensus_queue.cc:1048] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.836767 27112 raft_consensus.cc:1275] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Refusing update from remote peer b6197c79bf5a44cf9c5ffd0767267463: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251214 21:04:36.837185 27228 consensus_queue.cc:1048] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.840086 27192 raft_consensus.cc:1275] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Refusing update from remote peer b6197c79bf5a44cf9c5ffd0767267463: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20251214 21:04:36.840662 27228 consensus_queue.cc:1048] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:36.840804 27228 consensus_queue.cc:1243] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Peer 28d8e47dbd69466dbfa4256b374f3375 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251214 21:04:36.841372 27192 pending_rounds.cc:85] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Aborting all ops after (but not including) 0
I20251214 21:04:36.841428 27192 pending_rounds.cc:107] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20251214 21:04:36.841457 27192 raft_consensus.cc:2889] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251214 21:04:37.344049 27025 consensus_queue.cc:237] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.345561 27112 raft_consensus.cc:1275] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Refusing update from remote peer b6197c79bf5a44cf9c5ffd0767267463: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251214 21:04:37.345656 27192 raft_consensus.cc:1275] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Refusing update from remote peer b6197c79bf5a44cf9c5ffd0767267463: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251214 21:04:37.345957 27265 consensus_queue.cc:1048] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:37.346108 27228 consensus_queue.cc:1048] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:37.347561 27266 raft_consensus.cc:2955] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.347960 27192 raft_consensus.cc:2955] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.348229 27112 raft_consensus.cc:2955] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.350193 27192 consensus_queue.cc:237] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } attrs { replace: true } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.350296 26562 catalog_manager.cc:5654] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 reported cstate change: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New cstate: current_term: 3 leader_uuid: "b6197c79bf5a44cf9c5ffd0767267463" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:37.351472 27111 raft_consensus.cc:1275] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20251214 21:04:37.351620 26993 consensus_peers.cc:597] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 -> Peer a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4:37393): Couldn't send request to peer a23e1afc23e84bd98dd37a147eac6369. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61deee6d8e6b4dc39389a5b3662a98c0. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:37.351903 27025 raft_consensus.cc:1275] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:37.351863 27259 consensus_queue.cc:1048] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:37.352387 27259 consensus_queue.cc:1048] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:37.353370 27255 raft_consensus.cc:2955] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } attrs { replace: true } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.354003 27112 raft_consensus.cc:2955] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } attrs { replace: true } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.354169 27025 raft_consensus.cc:2955] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } attrs { replace: true } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.357996 27192 consensus_queue.cc:237] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } attrs { replace: true } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.358103 26562 catalog_manager.cc:5654] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 reported cstate change: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New cstate: current_term: 2 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:37.357996 27156 consensus_peers.cc:597] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 -> Peer a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4:37393): Couldn't send request to peer a23e1afc23e84bd98dd37a147eac6369. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5422d839d405479cb53a4e442395b4cf. This is attempt 1: this message will repeat every 5th retry.
W20251214 21:04:37.359436 27156 consensus_peers.cc:597] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 -> Peer a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4:37393): Couldn't send request to peer a23e1afc23e84bd98dd37a147eac6369. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e7ecef437b54cb0b0c4cf5ff4e55799. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:37.359532 27025 raft_consensus.cc:1275] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251214 21:04:37.359555 27112 raft_consensus.cc:1275] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Refusing update from remote peer 28d8e47dbd69466dbfa4256b374f3375: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251214 21:04:37.359848 27259 consensus_queue.cc:1048] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:37.360040 27255 consensus_queue.cc:1048] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:37.361500 27255 raft_consensus.cc:2955] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } attrs { replace: true } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.361960 27112 raft_consensus.cc:2955] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } attrs { replace: true } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.362262 27025 raft_consensus.cc:2955] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } attrs { replace: true } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.364002 26563 catalog_manager.cc:5654] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 reported cstate change: config changed from index -1 to 3, NON_VOTER a23e1afc23e84bd98dd37a147eac6369 (127.20.32.4) added. New cstate: current_term: 3 leader_uuid: "28d8e47dbd69466dbfa4256b374f3375" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } attrs { replace: true } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } } }
I20251214 21:04:37.723587 27278 ts_tablet_manager.cc:933] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: Initiating tablet copy from peer b6197c79bf5a44cf9c5ffd0767267463 (127.20.32.1:33051)
I20251214 21:04:37.723917 27278 tablet_copy_client.cc:323] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.1:33051
I20251214 21:04:37.727553 27032 tablet_copy_service.cc:140] P b6197c79bf5a44cf9c5ffd0767267463: Received BeginTabletCopySession request for tablet 61deee6d8e6b4dc39389a5b3662a98c0 from peer a23e1afc23e84bd98dd37a147eac6369 ({username='slave'} at 127.0.0.1:44634)
I20251214 21:04:37.727671 27032 tablet_copy_service.cc:161] P b6197c79bf5a44cf9c5ffd0767267463: Beginning new tablet copy session on tablet 61deee6d8e6b4dc39389a5b3662a98c0 from peer a23e1afc23e84bd98dd37a147eac6369 at {username='slave'} at 127.0.0.1:44634: session id = a23e1afc23e84bd98dd37a147eac6369-61deee6d8e6b4dc39389a5b3662a98c0
I20251214 21:04:37.728601 27032 tablet_copy_source_session.cc:215] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:37.729367 27278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61deee6d8e6b4dc39389a5b3662a98c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:37.731298 27278 tablet_copy_client.cc:806] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:37.731443 27278 tablet_copy_client.cc:670] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:37.732400 27278 tablet_copy_client.cc:538] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:37.733664 27278 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: Bootstrap starting.
I20251214 21:04:37.737483 27278 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:37.737757 27278 tablet_bootstrap.cc:492] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: Bootstrap complete.
I20251214 21:04:37.737929 27278 ts_tablet_manager.cc:1403] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.004s
I20251214 21:04:37.738353 27278 raft_consensus.cc:359] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.738467 27278 raft_consensus.cc:740] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a23e1afc23e84bd98dd37a147eac6369, State: Initialized, Role: LEARNER
I20251214 21:04:37.738543 27278 consensus_queue.cc:260] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.738960 27278 ts_tablet_manager.cc:1434] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:37.739408 27032 tablet_copy_service.cc:342] P b6197c79bf5a44cf9c5ffd0767267463: Request end of tablet copy session a23e1afc23e84bd98dd37a147eac6369-61deee6d8e6b4dc39389a5b3662a98c0 received from {username='slave'} at 127.0.0.1:44634
I20251214 21:04:37.739490 27032 tablet_copy_service.cc:434] P b6197c79bf5a44cf9c5ffd0767267463: ending tablet copy session a23e1afc23e84bd98dd37a147eac6369-61deee6d8e6b4dc39389a5b3662a98c0 on tablet 61deee6d8e6b4dc39389a5b3662a98c0 with peer a23e1afc23e84bd98dd37a147eac6369
I20251214 21:04:37.773950 27278 ts_tablet_manager.cc:933] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: Initiating tablet copy from peer 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:37.774297 27278 tablet_copy_client.cc:323] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:33147
I20251214 21:04:37.778057 27203 tablet_copy_service.cc:140] P 28d8e47dbd69466dbfa4256b374f3375: Received BeginTabletCopySession request for tablet 5422d839d405479cb53a4e442395b4cf from peer a23e1afc23e84bd98dd37a147eac6369 ({username='slave'} at 127.0.0.1:37716)
I20251214 21:04:37.778172 27203 tablet_copy_service.cc:161] P 28d8e47dbd69466dbfa4256b374f3375: Beginning new tablet copy session on tablet 5422d839d405479cb53a4e442395b4cf from peer a23e1afc23e84bd98dd37a147eac6369 at {username='slave'} at 127.0.0.1:37716: session id = a23e1afc23e84bd98dd37a147eac6369-5422d839d405479cb53a4e442395b4cf
I20251214 21:04:37.778951 27203 tablet_copy_source_session.cc:215] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:37.779727 27278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5422d839d405479cb53a4e442395b4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:37.781788 27278 tablet_copy_client.cc:806] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:37.781947 27278 tablet_copy_client.cc:670] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:37.782864 27278 tablet_copy_client.cc:538] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:37.783965 27278 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: Bootstrap starting.
I20251214 21:04:37.787712 27278 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:37.787947 27278 tablet_bootstrap.cc:492] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: Bootstrap complete.
I20251214 21:04:37.788103 27278 ts_tablet_manager.cc:1403] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:04:37.788558 27278 raft_consensus.cc:359] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } attrs { replace: true } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.788690 27278 raft_consensus.cc:740] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a23e1afc23e84bd98dd37a147eac6369, State: Initialized, Role: LEARNER
I20251214 21:04:37.788794 27278 consensus_queue.cc:260] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } attrs { replace: true } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.789062 27278 ts_tablet_manager.cc:1434] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:37.789480 27203 tablet_copy_service.cc:342] P 28d8e47dbd69466dbfa4256b374f3375: Request end of tablet copy session a23e1afc23e84bd98dd37a147eac6369-5422d839d405479cb53a4e442395b4cf received from {username='slave'} at 127.0.0.1:37716
I20251214 21:04:37.789587 27203 tablet_copy_service.cc:434] P 28d8e47dbd69466dbfa4256b374f3375: ending tablet copy session a23e1afc23e84bd98dd37a147eac6369-5422d839d405479cb53a4e442395b4cf on tablet 5422d839d405479cb53a4e442395b4cf with peer a23e1afc23e84bd98dd37a147eac6369
I20251214 21:04:37.792896 27278 ts_tablet_manager.cc:933] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: Initiating tablet copy from peer 28d8e47dbd69466dbfa4256b374f3375 (127.20.32.3:33147)
I20251214 21:04:37.793259 27278 tablet_copy_client.cc:323] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:33147
I20251214 21:04:37.793625 27203 tablet_copy_service.cc:140] P 28d8e47dbd69466dbfa4256b374f3375: Received BeginTabletCopySession request for tablet 2e7ecef437b54cb0b0c4cf5ff4e55799 from peer a23e1afc23e84bd98dd37a147eac6369 ({username='slave'} at 127.0.0.1:37716)
I20251214 21:04:37.793751 27203 tablet_copy_service.cc:161] P 28d8e47dbd69466dbfa4256b374f3375: Beginning new tablet copy session on tablet 2e7ecef437b54cb0b0c4cf5ff4e55799 from peer a23e1afc23e84bd98dd37a147eac6369 at {username='slave'} at 127.0.0.1:37716: session id = a23e1afc23e84bd98dd37a147eac6369-2e7ecef437b54cb0b0c4cf5ff4e55799
I20251214 21:04:37.794466 27203 tablet_copy_source_session.cc:215] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:37.795190 27278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7ecef437b54cb0b0c4cf5ff4e55799. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:37.797117 27278 tablet_copy_client.cc:806] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:37.797267 27278 tablet_copy_client.cc:670] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:37.798156 27278 tablet_copy_client.cc:538] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:37.799583 27278 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: Bootstrap starting.
I20251214 21:04:37.803645 27278 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:37.803901 27278 tablet_bootstrap.cc:492] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: Bootstrap complete.
I20251214 21:04:37.804124 27278 ts_tablet_manager.cc:1403] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.001s
I20251214 21:04:37.804620 27278 raft_consensus.cc:359] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } attrs { replace: true } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.804751 27278 raft_consensus.cc:740] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a23e1afc23e84bd98dd37a147eac6369, State: Initialized, Role: LEARNER
I20251214 21:04:37.804857 27278 consensus_queue.cc:260] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b6197c79bf5a44cf9c5ffd0767267463" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 33051 } attrs { replace: true } } peers { permanent_uuid: "ef4aa669b37244a4af7b55f17c99ae80" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 45565 } } peers { permanent_uuid: "28d8e47dbd69466dbfa4256b374f3375" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33147 } } peers { permanent_uuid: "a23e1afc23e84bd98dd37a147eac6369" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 37393 } attrs { promote: true } }
I20251214 21:04:37.805140 27278 ts_tablet_manager.cc:1434] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:37.805538 27203 tablet_copy_service.cc:342] P 28d8e47dbd69466dbfa4256b374f3375: Request end of tablet copy session a23e1afc23e84bd98dd37a147eac6369-2e7ecef437b54cb0b0c4cf5ff4e55799 received from {username='slave'} at 127.0.0.1:37716
I20251214 21:04:37.805622 27203 tablet_copy_service.cc:434] P 28d8e47dbd69466dbfa4256b374f3375: ending tablet copy session a23e1afc23e84bd98dd37a147eac6369-2e7ecef437b54cb0b0c4cf5ff4e55799 on tablet 2e7ecef437b54cb0b0c4cf5ff4e55799 with peer a23e1afc23e84bd98dd37a147eac6369
I20251214 21:04:38.216559 26937 raft_consensus.cc:1217] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20251214 21:04:38.345217 26937 raft_consensus.cc:1217] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20251214 21:04:38.377310 26937 raft_consensus.cc:1217] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20251214 21:04:38.551286 20608 tablet_server.cc:178] TabletServer@127.20.32.1:33051 shutting down...
W20251214 21:04:38.553273 26606 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20251214 21:04:38.554242 26612 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251214 21:04:38.554338 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251214 21:04:38.555182 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:38.555346 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.555471 20608 raft_consensus.cc:2243] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 LEADER]: Raft consensus shutting down.
I20251214 21:04:38.555696 20608 raft_consensus.cc:2272] T 61deee6d8e6b4dc39389a5b3662a98c0 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.556133 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.556221 20608 raft_consensus.cc:2243] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:38.556316 20608 raft_consensus.cc:2272] T 5422d839d405479cb53a4e442395b4cf P b6197c79bf5a44cf9c5ffd0767267463 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.556612 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.556691 20608 raft_consensus.cc:2243] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:38.556792 20608 raft_consensus.cc:2272] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.557118 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.557207 20608 raft_consensus.cc:2243] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:38.557296 20608 raft_consensus.cc:2272] T f30ac5dafe604761b15603b2c748ad26 P b6197c79bf5a44cf9c5ffd0767267463 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.560679 20608 tablet_server.cc:195] TabletServer@127.20.32.1:33051 shutdown complete.
I20251214 21:04:38.563222 20608 tablet_server.cc:178] TabletServer@127.20.32.2:45565 shutting down...
I20251214 21:04:38.566797 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:38.566969 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.567114 20608 raft_consensus.cc:2243] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:38.567229 20608 raft_consensus.cc:2272] T 61deee6d8e6b4dc39389a5b3662a98c0 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.567603 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.567696 20608 raft_consensus.cc:2243] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:38.567798 20608 raft_consensus.cc:2272] T 5422d839d405479cb53a4e442395b4cf P ef4aa669b37244a4af7b55f17c99ae80 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.568104 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.568185 20608 raft_consensus.cc:2243] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:38.568277 20608 raft_consensus.cc:2272] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.568614 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.568704 20608 raft_consensus.cc:2243] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:38.568794 20608 raft_consensus.cc:2272] T f30ac5dafe604761b15603b2c748ad26 P ef4aa669b37244a4af7b55f17c99ae80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.582044 20608 tablet_server.cc:195] TabletServer@127.20.32.2:45565 shutdown complete.
I20251214 21:04:38.584590 20608 tablet_server.cc:178] TabletServer@127.20.32.3:33147 shutting down...
W20251214 21:04:38.586221 26612 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251214 21:04:38.586287 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251214 21:04:38.587333 26612 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20251214 21:04:38.587440 26612 auto_rebalancer.cc:263] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20251214 21:04:38.588872 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:38.589025 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.589123 20608 raft_consensus.cc:2243] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:38.589229 20608 raft_consensus.cc:2272] T 61deee6d8e6b4dc39389a5b3662a98c0 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.589617 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.589748 20608 raft_consensus.cc:2243] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:04:38.589924 20608 raft_consensus.cc:2272] T 5422d839d405479cb53a4e442395b4cf P 28d8e47dbd69466dbfa4256b374f3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.590224 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.590298 20608 raft_consensus.cc:2243] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 LEADER]: Raft consensus shutting down.
I20251214 21:04:38.590438 20608 raft_consensus.cc:2272] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.590718 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:38.590783 20608 raft_consensus.cc:2243] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 LEADER]: Raft consensus shutting down.
I20251214 21:04:38.590904 20608 raft_consensus.cc:2272] T f30ac5dafe604761b15603b2c748ad26 P 28d8e47dbd69466dbfa4256b374f3375 [term 3 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.603821 20608 tablet_server.cc:195] TabletServer@127.20.32.3:33147 shutdown complete.
I20251214 21:04:38.606206 20608 tablet_server.cc:178] TabletServer@127.20.32.4:0 shutting down...
I20251214 21:04:38.609227 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:38.609531 20608 tablet_replica.cc:333] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369: stopping tablet replica
I20251214 21:04:38.609659 20608 raft_consensus.cc:2243] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Raft consensus shutting down.
I20251214 21:04:38.609824 20608 raft_consensus.cc:2272] T 2e7ecef437b54cb0b0c4cf5ff4e55799 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Raft consensus is shut down!
I20251214 21:04:38.610253 20608 tablet_replica.cc:333] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369: stopping tablet replica
I20251214 21:04:38.610329 20608 raft_consensus.cc:2243] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Raft consensus shutting down.
I20251214 21:04:38.610409 20608 raft_consensus.cc:2272] T 61deee6d8e6b4dc39389a5b3662a98c0 P a23e1afc23e84bd98dd37a147eac6369 [term 3 LEARNER]: Raft consensus is shut down!
I20251214 21:04:38.610714 20608 tablet_replica.cc:333] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369: stopping tablet replica
I20251214 21:04:38.610785 20608 raft_consensus.cc:2243] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369 [term 2 LEARNER]: Raft consensus shutting down.
I20251214 21:04:38.610863 20608 raft_consensus.cc:2272] T 5422d839d405479cb53a4e442395b4cf P a23e1afc23e84bd98dd37a147eac6369 [term 2 LEARNER]: Raft consensus is shut down!
I20251214 21:04:38.623312 20608 tablet_server.cc:195] TabletServer@127.20.32.4:0 shutdown complete.
I20251214 21:04:38.625545 20608 master.cc:561] Master@127.20.32.62:42757 shutting down...
I20251214 21:04:38.628935 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:38.629110 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:38.629176 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 615d9df749f9473b98a9d971f4dd1e8c: stopping tablet replica
I20251214 21:04:38.641957 20608 master.cc:583] Master@127.20.32.62:42757 shutdown complete.
[ OK ] AutoRebalancerTest.TestHandlingFailedTservers (11398 ms)
[ RUN ] AutoRebalancerTest.TestDeletedTables
I20251214 21:04:38.650568 20608 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.32.62:43059
I20251214 21:04:38.650913 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:38.652524 27295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:38.652648 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:38.652551 27297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:38.652570 27294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:38.652908 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:38.652952 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:38.652966 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746278652966 us; error 0 us; skew 500 ppm
I20251214 21:04:38.653776 20608 webserver.cc:492] Webserver started at http://127.20.32.62:37767/ using document root <none> and password file <none>
I20251214 21:04:38.653896 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:38.653932 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:38.653983 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:38.654300 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/master-0-root/instance:
uuid: "7ea09f60014a4e819099454a84890338"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:38.655628 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251214 21:04:38.656584 27302 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.656840 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:38.656904 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/master-0-root
uuid: "7ea09f60014a4e819099454a84890338"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:38.656973 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:38.677577 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:38.678012 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:38.681870 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.62:43059
I20251214 21:04:38.684692 27354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.62:43059 every 8 connection(s)
I20251214 21:04:38.685249 27355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:38.687290 27355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: Bootstrap starting.
I20251214 21:04:38.688056 27355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:38.689009 27355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: No bootstrap required, opened a new log
I20251214 21:04:38.689483 27355 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea09f60014a4e819099454a84890338" member_type: VOTER }
I20251214 21:04:38.689574 27355 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:38.689599 27355 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ea09f60014a4e819099454a84890338, State: Initialized, Role: FOLLOWER
I20251214 21:04:38.689733 27355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea09f60014a4e819099454a84890338" member_type: VOTER }
I20251214 21:04:38.689810 27355 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:38.689839 27355 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:38.689872 27355 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:38.690549 27355 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea09f60014a4e819099454a84890338" member_type: VOTER }
I20251214 21:04:38.690652 27355 leader_election.cc:304] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ea09f60014a4e819099454a84890338; no voters:
I20251214 21:04:38.690806 27355 leader_election.cc:290] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:38.690923 27358 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:38.691116 27358 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 1 LEADER]: Becoming Leader. State: Replica: 7ea09f60014a4e819099454a84890338, State: Running, Role: LEADER
I20251214 21:04:38.691195 27355 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:38.691236 27358 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea09f60014a4e819099454a84890338" member_type: VOTER }
I20251214 21:04:38.691717 27360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ea09f60014a4e819099454a84890338. Latest consensus state: current_term: 1 leader_uuid: "7ea09f60014a4e819099454a84890338" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea09f60014a4e819099454a84890338" member_type: VOTER } }
I20251214 21:04:38.691701 27359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ea09f60014a4e819099454a84890338" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea09f60014a4e819099454a84890338" member_type: VOTER } }
I20251214 21:04:38.691848 27360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:38.691881 27359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:38.692122 27365 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:38.693128 27365 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:38.693414 20608 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251214 21:04:38.695116 27365 catalog_manager.cc:1357] Generated new cluster ID: 66d0112a113d4d40959b14aceafb8feb
I20251214 21:04:38.695179 27365 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:38.700403 27365 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:38.701200 27365 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:38.707065 27365 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: Generated new TSK 0
I20251214 21:04:38.707242 27365 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:38.709867 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:38.711808 27379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:38.711773 27377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:38.711812 27376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:38.712127 20608 server_base.cc:1047] running on GCE node
I20251214 21:04:38.712280 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:38.712328 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:38.712349 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746278712348 us; error 0 us; skew 500 ppm
I20251214 21:04:38.713222 20608 webserver.cc:492] Webserver started at http://127.20.32.1:46613/ using document root <none> and password file <none>
I20251214 21:04:38.713366 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:38.713411 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:38.713485 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:38.713917 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root/instance:
uuid: "9151de528de149029e1ddc479a91632a"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:38.715318 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:38.716202 27384 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.716418 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:38.716480 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "9151de528de149029e1ddc479a91632a"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:38.716548 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:38.741201 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:38.741636 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:38.741966 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:38.742425 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:38.742465 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.742507 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:38.742534 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.746335 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:37275
I20251214 21:04:38.746376 27447 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:37275 every 8 connection(s)
I20251214 21:04:38.747112 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:38.748811 27453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:38.748855 27452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:38.749028 27455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:38.749096 20608 server_base.cc:1047] running on GCE node
I20251214 21:04:38.749336 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:38.749390 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:38.749411 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746278749410 us; error 0 us; skew 500 ppm
I20251214 21:04:38.750300 20608 webserver.cc:492] Webserver started at http://127.20.32.2:35551/ using document root <none> and password file <none>
I20251214 21:04:38.750452 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:38.750506 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:38.750579 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:38.751015 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root/instance:
uuid: "e6dae6a96e704090a803841fada0a24c"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:38.751487 27448 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43059
I20251214 21:04:38.751572 27448 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:38.751802 27448 heartbeater.cc:507] Master 127.20.32.62:43059 requested a full tablet report, sending...
I20251214 21:04:38.752384 27319 ts_manager.cc:194] Registered new tserver with Master: 9151de528de149029e1ddc479a91632a (127.20.32.1:37275)
I20251214 21:04:38.752605 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:38.753134 27319 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57996
I20251214 21:04:38.753526 27460 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.753798 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:38.753857 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root
uuid: "e6dae6a96e704090a803841fada0a24c"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:38.753929 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:38.768293 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:38.768707 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:38.768996 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:38.769471 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:38.769511 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.769554 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:38.769580 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.774947 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.2:37787
I20251214 21:04:38.775009 27523 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.2:37787 every 8 connection(s)
I20251214 21:04:38.776182 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:38.778286 27530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:38.778277 27527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:38.778424 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:38.778280 27528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:38.778695 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:38.778759 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:38.778779 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746278778778 us; error 0 us; skew 500 ppm
I20251214 21:04:38.779881 20608 webserver.cc:492] Webserver started at http://127.20.32.3:37381/ using document root <none> and password file <none>
I20251214 21:04:38.780050 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:38.780115 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:38.780190 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:38.780577 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root/instance:
uuid: "cacfd002884a45f8a129df8020e6ded6"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:38.780757 27524 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43059
I20251214 21:04:38.780861 27524 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:38.781113 27524 heartbeater.cc:507] Master 127.20.32.62:43059 requested a full tablet report, sending...
I20251214 21:04:38.782025 27319 ts_manager.cc:194] Registered new tserver with Master: e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:38.782265 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:38.782735 27319 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58004
I20251214 21:04:38.783417 27535 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.783759 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:38.783835 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root
uuid: "cacfd002884a45f8a129df8020e6ded6"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:38.783910 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:38.794536 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:38.794968 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:38.795245 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:38.795682 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:38.795722 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.795763 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:38.795789 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:38.799819 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.3:33175
I20251214 21:04:38.799939 27598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.3:33175 every 8 connection(s)
I20251214 21:04:38.805063 27599 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43059
I20251214 21:04:38.805179 27599 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:38.805388 27599 heartbeater.cc:507] Master 127.20.32.62:43059 requested a full tablet report, sending...
I20251214 21:04:38.806025 27319 ts_manager.cc:194] Registered new tserver with Master: cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:38.806548 27319 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58020
I20251214 21:04:38.806989 20608 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.006715341s
I20251214 21:04:39.754297 27448 heartbeater.cc:499] Master 127.20.32.62:43059 was elected leader, sending a full tablet report...
I20251214 21:04:39.783809 27524 heartbeater.cc:499] Master 127.20.32.62:43059 was elected leader, sending a full tablet report...
I20251214 21:04:39.807518 27599 heartbeater.cc:499] Master 127.20.32.62:43059 was elected leader, sending a full tablet report...
I20251214 21:04:39.833364 20608 test_util.cc:276] Using random seed: -674898161
I20251214 21:04:39.846689 27319 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52142:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:04:39.847185 27319 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:04:39.857745 27412 tablet_service.cc:1505] Processing CreateTablet for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:39.857829 27411 tablet_service.cc:1505] Processing CreateTablet for tablet bac0097611aa492ab9588fa41e5c25ee (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:39.857833 27410 tablet_service.cc:1505] Processing CreateTablet for tablet 46988503d5024be48fb69a2b1d4536b1 (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:39.858101 27411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac0097611aa492ab9588fa41e5c25ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.858224 27412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.858470 27410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46988503d5024be48fb69a2b1d4536b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.860899 27563 tablet_service.cc:1505] Processing CreateTablet for tablet bac0097611aa492ab9588fa41e5c25ee (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:39.860967 27560 tablet_service.cc:1505] Processing CreateTablet for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:39.861126 27561 tablet_service.cc:1505] Processing CreateTablet for tablet 25ada40c9f8d4da99eda6d54daad418c (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:39.861249 27562 tablet_service.cc:1505] Processing CreateTablet for tablet 46988503d5024be48fb69a2b1d4536b1 (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:39.860915 27409 tablet_service.cc:1505] Processing CreateTablet for tablet 25ada40c9f8d4da99eda6d54daad418c (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:39.861511 27409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ada40c9f8d4da99eda6d54daad418c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.861536 27619 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:39.861196 27563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac0097611aa492ab9588fa41e5c25ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.861884 27562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46988503d5024be48fb69a2b1d4536b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.862033 27560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.863888 27620 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: Bootstrap starting.
I20251214 21:04:39.864279 27561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ada40c9f8d4da99eda6d54daad418c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.864557 27619 tablet_bootstrap.cc:654] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.865085 27620 tablet_bootstrap.cc:654] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.866537 27620 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: No bootstrap required, opened a new log
I20251214 21:04:39.866537 27619 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: No bootstrap required, opened a new log
I20251214 21:04:39.866683 27619 ts_tablet_manager.cc:1403] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251214 21:04:39.866683 27620 ts_tablet_manager.cc:1403] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:39.866775 27488 tablet_service.cc:1505] Processing CreateTablet for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:39.866875 27487 tablet_service.cc:1505] Processing CreateTablet for tablet bac0097611aa492ab9588fa41e5c25ee (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:39.867020 27488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.867163 27619 raft_consensus.cc:359] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.867254 27619 raft_consensus.cc:385] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.867233 27486 tablet_service.cc:1505] Processing CreateTablet for tablet 46988503d5024be48fb69a2b1d4536b1 (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:39.867290 27619 raft_consensus.cc:740] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.867457 27486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46988503d5024be48fb69a2b1d4536b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.867444 27619 consensus_queue.cc:260] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.867749 27619 ts_tablet_manager.cc:1434] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:39.867900 27619 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:39.868692 27619 tablet_bootstrap.cc:654] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.868997 27624 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c: Bootstrap starting.
I20251214 21:04:39.869293 27620 raft_consensus.cc:359] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.869422 27620 raft_consensus.cc:385] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.869410 27485 tablet_service.cc:1505] Processing CreateTablet for tablet 25ada40c9f8d4da99eda6d54daad418c (DEFAULT_TABLE table=test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:39.869515 27620 raft_consensus.cc:740] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.869674 27485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ada40c9f8d4da99eda6d54daad418c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.869692 27620 consensus_queue.cc:260] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.870117 27620 ts_tablet_manager.cc:1434] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:04:39.870312 27620 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: Bootstrap starting.
I20251214 21:04:39.871224 27620 tablet_bootstrap.cc:654] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.871693 27487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac0097611aa492ab9588fa41e5c25ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:39.872202 27624 tablet_bootstrap.cc:654] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.872290 27619 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: No bootstrap required, opened a new log
I20251214 21:04:39.872368 27619 ts_tablet_manager.cc:1403] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251214 21:04:39.872771 27619 raft_consensus.cc:359] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.872872 27619 raft_consensus.cc:385] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.872901 27619 raft_consensus.cc:740] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.873013 27619 consensus_queue.cc:260] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.873237 27619 ts_tablet_manager.cc:1434] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:39.873406 27619 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:39.873427 27620 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: No bootstrap required, opened a new log
I20251214 21:04:39.873500 27620 ts_tablet_manager.cc:1403] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251214 21:04:39.873919 27620 raft_consensus.cc:359] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.874039 27620 raft_consensus.cc:385] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.874073 27620 raft_consensus.cc:740] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.874186 27620 consensus_queue.cc:260] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.874308 27619 tablet_bootstrap.cc:654] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.874418 27620 ts_tablet_manager.cc:1434] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:39.874572 27620 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6: Bootstrap starting.
I20251214 21:04:39.875460 27619 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: No bootstrap required, opened a new log
I20251214 21:04:39.875497 27620 tablet_bootstrap.cc:654] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.875530 27619 ts_tablet_manager.cc:1403] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251214 21:04:39.875918 27619 raft_consensus.cc:359] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.876010 27619 raft_consensus.cc:385] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.876051 27619 raft_consensus.cc:740] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.876161 27619 consensus_queue.cc:260] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.876538 27620 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6: No bootstrap required, opened a new log
I20251214 21:04:39.876616 27620 ts_tablet_manager.cc:1403] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:39.876674 27624 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c: No bootstrap required, opened a new log
I20251214 21:04:39.876749 27624 ts_tablet_manager.cc:1403] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251214 21:04:39.876899 27619 ts_tablet_manager.cc:1434] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:39.877048 27619 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:39.877003 27620 raft_consensus.cc:359] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.877104 27620 raft_consensus.cc:385] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.877138 27620 raft_consensus.cc:740] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.877156 27624 raft_consensus.cc:359] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.877231 27624 raft_consensus.cc:385] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.877259 27624 raft_consensus.cc:740] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.877250 27620 consensus_queue.cc:260] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.877390 27624 consensus_queue.cc:260] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.877504 27620 ts_tablet_manager.cc:1434] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:39.877655 27620 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6: Bootstrap starting.
I20251214 21:04:39.877719 27624 ts_tablet_manager.cc:1434] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:39.877882 27624 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c: Bootstrap starting.
I20251214 21:04:39.877933 27619 tablet_bootstrap.cc:654] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.878556 27620 tablet_bootstrap.cc:654] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.878697 27624 tablet_bootstrap.cc:654] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.879526 27620 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6: No bootstrap required, opened a new log
I20251214 21:04:39.879612 27620 ts_tablet_manager.cc:1403] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:39.879796 27624 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c: No bootstrap required, opened a new log
I20251214 21:04:39.879874 27624 ts_tablet_manager.cc:1403] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:39.880005 27620 raft_consensus.cc:359] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.880118 27620 raft_consensus.cc:385] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.880195 27620 raft_consensus.cc:740] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.880263 27624 raft_consensus.cc:359] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.880313 27620 consensus_queue.cc:260] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.880357 27624 raft_consensus.cc:385] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.880613 27620 ts_tablet_manager.cc:1434] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:39.880627 27624 raft_consensus.cc:740] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.880801 27624 consensus_queue.cc:260] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.881119 27624 ts_tablet_manager.cc:1434] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:39.881275 27624 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c: Bootstrap starting.
I20251214 21:04:39.882076 27624 tablet_bootstrap.cc:654] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.882309 27619 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: No bootstrap required, opened a new log
I20251214 21:04:39.882387 27619 ts_tablet_manager.cc:1403] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20251214 21:04:39.882800 27619 raft_consensus.cc:359] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.882884 27619 raft_consensus.cc:385] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.882913 27619 raft_consensus.cc:740] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.882997 27624 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c: No bootstrap required, opened a new log
I20251214 21:04:39.883013 27619 consensus_queue.cc:260] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.883060 27624 ts_tablet_manager.cc:1403] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:39.883252 27619 ts_tablet_manager.cc:1434] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:39.883514 27624 raft_consensus.cc:359] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.883633 27624 raft_consensus.cc:385] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.883669 27624 raft_consensus.cc:740] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.883778 27624 consensus_queue.cc:260] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.884016 27624 ts_tablet_manager.cc:1434] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:39.884178 27624 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: Bootstrap starting.
I20251214 21:04:39.885128 27624 tablet_bootstrap.cc:654] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:39.886189 27624 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: No bootstrap required, opened a new log
I20251214 21:04:39.886267 27624 ts_tablet_manager.cc:1403] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:39.886611 27624 raft_consensus.cc:359] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.886719 27624 raft_consensus.cc:385] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:39.886760 27624 raft_consensus.cc:740] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Initialized, Role: FOLLOWER
I20251214 21:04:39.886873 27624 consensus_queue.cc:260] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.887141 27624 ts_tablet_manager.cc:1434] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:39.921042 27626 raft_consensus.cc:493] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:39.921202 27626 raft_consensus.cc:515] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.921757 27626 leader_election.cc:290] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:39.925182 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bac0097611aa492ab9588fa41e5c25ee" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c" is_pre_election: true
I20251214 21:04:39.925190 27422 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bac0097611aa492ab9588fa41e5c25ee" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a" is_pre_election: true
I20251214 21:04:39.925325 27498 raft_consensus.cc:2468] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 0.
I20251214 21:04:39.925343 27422 raft_consensus.cc:2468] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 0.
I20251214 21:04:39.925607 27537 leader_election.cc:304] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:39.925794 27626 raft_consensus.cc:2804] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:39.925849 27626 raft_consensus.cc:493] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:39.925894 27626 raft_consensus.cc:3060] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.926713 27626 raft_consensus.cc:515] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.927031 27626 leader_election.cc:290] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 election: Requested vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:39.927302 27422 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bac0097611aa492ab9588fa41e5c25ee" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a"
I20251214 21:04:39.927350 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bac0097611aa492ab9588fa41e5c25ee" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c"
I20251214 21:04:39.927521 27498 raft_consensus.cc:3060] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.927526 27422 raft_consensus.cc:3060] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.928376 27422 raft_consensus.cc:2468] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 1.
I20251214 21:04:39.928386 27498 raft_consensus.cc:2468] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 1.
I20251214 21:04:39.928627 27537 leader_election.cc:304] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, cacfd002884a45f8a129df8020e6ded6; no voters:
I20251214 21:04:39.928763 27626 raft_consensus.cc:2804] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:39.928967 27626 raft_consensus.cc:697] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Becoming Leader. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Running, Role: LEADER
I20251214 21:04:39.929097 27626 consensus_queue.cc:237] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.930622 27317 catalog_manager.cc:5654] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cacfd002884a45f8a129df8020e6ded6 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "cacfd002884a45f8a129df8020e6ded6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:39.946883 27623 raft_consensus.cc:493] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:39.947036 27623 raft_consensus.cc:515] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.947517 27623 leader_election.cc:290] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:39.951556 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25ada40c9f8d4da99eda6d54daad418c" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6" is_pre_election: true
I20251214 21:04:39.951666 27573 raft_consensus.cc:2468] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 0.
I20251214 21:04:39.951642 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25ada40c9f8d4da99eda6d54daad418c" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c" is_pre_election: true
I20251214 21:04:39.951808 27498 raft_consensus.cc:2468] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 0.
I20251214 21:04:39.951980 27387 leader_election.cc:304] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, cacfd002884a45f8a129df8020e6ded6; no voters:
I20251214 21:04:39.952154 27623 raft_consensus.cc:2804] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:39.952219 27623 raft_consensus.cc:493] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:39.952258 27623 raft_consensus.cc:3060] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.953059 27623 raft_consensus.cc:515] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.953351 27623 leader_election.cc:290] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 election: Requested vote from peers e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:39.953604 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25ada40c9f8d4da99eda6d54daad418c" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c"
I20251214 21:04:39.953620 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25ada40c9f8d4da99eda6d54daad418c" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6"
I20251214 21:04:39.953725 27498 raft_consensus.cc:3060] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.953765 27573 raft_consensus.cc:3060] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.954455 27498 raft_consensus.cc:2468] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 1.
I20251214 21:04:39.954489 27573 raft_consensus.cc:2468] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 1.
I20251214 21:04:39.954730 27387 leader_election.cc:304] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, cacfd002884a45f8a129df8020e6ded6; no voters:
I20251214 21:04:39.954885 27623 raft_consensus.cc:2804] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:39.955071 27623 raft_consensus.cc:697] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: Becoming Leader. State: Replica: 9151de528de149029e1ddc479a91632a, State: Running, Role: LEADER
I20251214 21:04:39.955200 27623 consensus_queue.cc:237] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.956532 27317 catalog_manager.cc:5654] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9151de528de149029e1ddc479a91632a (127.20.32.1). New cstate: current_term: 1 leader_uuid: "9151de528de149029e1ddc479a91632a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:39.971128 27623 raft_consensus.cc:493] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:39.971272 27623 raft_consensus.cc:515] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.971649 27623 leader_election.cc:290] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:39.972060 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6b77cc1d2e4434a8b5a23ed5d786aa7" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6" is_pre_election: true
I20251214 21:04:39.972071 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6b77cc1d2e4434a8b5a23ed5d786aa7" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c" is_pre_election: true
I20251214 21:04:39.972229 27573 raft_consensus.cc:2468] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 0.
I20251214 21:04:39.972230 27498 raft_consensus.cc:2468] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 0.
I20251214 21:04:39.972481 27387 leader_election.cc:304] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, cacfd002884a45f8a129df8020e6ded6; no voters:
I20251214 21:04:39.972627 27623 raft_consensus.cc:2804] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:39.972684 27623 raft_consensus.cc:493] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:39.972729 27623 raft_consensus.cc:3060] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.973536 27623 raft_consensus.cc:515] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.973865 27623 leader_election.cc:290] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 election: Requested vote from peers e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:39.974152 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6b77cc1d2e4434a8b5a23ed5d786aa7" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c"
I20251214 21:04:39.974152 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6b77cc1d2e4434a8b5a23ed5d786aa7" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6"
I20251214 21:04:39.974251 27498 raft_consensus.cc:3060] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.974305 27573 raft_consensus.cc:3060] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.975035 27498 raft_consensus.cc:2468] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 1.
I20251214 21:04:39.975210 27573 raft_consensus.cc:2468] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 1.
I20251214 21:04:39.975304 27386 leader_election.cc:304] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:39.975452 27623 raft_consensus.cc:2804] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:39.975519 27623 raft_consensus.cc:697] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: Becoming Leader. State: Replica: 9151de528de149029e1ddc479a91632a, State: Running, Role: LEADER
I20251214 21:04:39.975646 27623 consensus_queue.cc:237] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.977073 27317 catalog_manager.cc:5654] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9151de528de149029e1ddc479a91632a (127.20.32.1). New cstate: current_term: 1 leader_uuid: "9151de528de149029e1ddc479a91632a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:39.983701 27623 raft_consensus.cc:493] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:39.983855 27623 raft_consensus.cc:515] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.984248 27623 leader_election.cc:290] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:39.984647 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46988503d5024be48fb69a2b1d4536b1" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c" is_pre_election: true
I20251214 21:04:39.984647 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46988503d5024be48fb69a2b1d4536b1" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6" is_pre_election: true
I20251214 21:04:39.984820 27498 raft_consensus.cc:2468] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 0.
I20251214 21:04:39.984843 27573 raft_consensus.cc:2468] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 0.
I20251214 21:04:39.985071 27386 leader_election.cc:304] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:39.985230 27623 raft_consensus.cc:2804] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:39.985292 27623 raft_consensus.cc:493] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:39.985332 27623 raft_consensus.cc:3060] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.986192 27623 raft_consensus.cc:515] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.986495 27623 leader_election.cc:290] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 election: Requested vote from peers e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:39.986779 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46988503d5024be48fb69a2b1d4536b1" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c"
I20251214 21:04:39.986783 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46988503d5024be48fb69a2b1d4536b1" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6"
I20251214 21:04:39.986879 27498 raft_consensus.cc:3060] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.986891 27573 raft_consensus.cc:3060] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:39.987594 27498 raft_consensus.cc:2468] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 1.
I20251214 21:04:39.987604 27573 raft_consensus.cc:2468] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 1.
I20251214 21:04:39.987869 27387 leader_election.cc:304] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, cacfd002884a45f8a129df8020e6ded6; no voters:
I20251214 21:04:39.988016 27623 raft_consensus.cc:2804] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:39.988086 27623 raft_consensus.cc:697] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: Becoming Leader. State: Replica: 9151de528de149029e1ddc479a91632a, State: Running, Role: LEADER
I20251214 21:04:39.988211 27623 consensus_queue.cc:237] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:39.989602 27317 catalog_manager.cc:5654] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9151de528de149029e1ddc479a91632a (127.20.32.1). New cstate: current_term: 1 leader_uuid: "9151de528de149029e1ddc479a91632a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:40.002188 20608 test_util.cc:276] Using random seed: -674729339
I20251214 21:04:40.009827 27317 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52148:
name: "dugtrio"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:04:40.010360 27317 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table dugtrio in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:04:40.015810 27409 tablet_service.cc:1505] Processing CreateTablet for tablet e47b2e59579c45479dca6982b03b54f8 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:40.015956 27487 tablet_service.cc:1505] Processing CreateTablet for tablet e47b2e59579c45479dca6982b03b54f8 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:40.016131 27409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47b2e59579c45479dca6982b03b54f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.016211 27487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47b2e59579c45479dca6982b03b54f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.016129 27561 tablet_service.cc:1505] Processing CreateTablet for tablet e47b2e59579c45479dca6982b03b54f8 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251214 21:04:40.016376 27561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47b2e59579c45479dca6982b03b54f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.017900 27412 tablet_service.cc:1505] Processing CreateTablet for tablet 15b77f7899e246999b61b95f8bf64b4f (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:40.018121 27412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b77f7899e246999b61b95f8bf64b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.018409 27624 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: Bootstrap starting.
I20251214 21:04:40.018491 27410 tablet_service.cc:1505] Processing CreateTablet for tablet 119cab43f5194eeb8fbab9dbcd3886c7 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:40.018689 27410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119cab43f5194eeb8fbab9dbcd3886c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.019338 27624 tablet_bootstrap.cc:654] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.019760 27411 tablet_service.cc:1505] Processing CreateTablet for tablet 7acbc965e6da4e8b93ec716a5904f7d5 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:40.019932 27411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acbc965e6da4e8b93ec716a5904f7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.020478 27624 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: No bootstrap required, opened a new log
I20251214 21:04:40.020534 27620 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: Bootstrap starting.
I20251214 21:04:40.020552 27624 ts_tablet_manager.cc:1403] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251214 21:04:40.020972 27624 raft_consensus.cc:359] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.021075 27624 raft_consensus.cc:385] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.021106 27624 raft_consensus.cc:740] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.021216 27624 consensus_queue.cc:260] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.021345 27619 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:40.021450 27620 tablet_bootstrap.cc:654] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.021467 27624 ts_tablet_manager.cc:1434] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:40.022092 27619 tablet_bootstrap.cc:654] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.022387 27487 tablet_service.cc:1505] Processing CreateTablet for tablet 15b77f7899e246999b61b95f8bf64b4f (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:40.022459 27620 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: No bootstrap required, opened a new log
I20251214 21:04:40.022472 27485 tablet_service.cc:1505] Processing CreateTablet for tablet 7acbc965e6da4e8b93ec716a5904f7d5 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:40.022586 27620 ts_tablet_manager.cc:1403] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:40.022593 27487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b77f7899e246999b61b95f8bf64b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.022848 27486 tablet_service.cc:1505] Processing CreateTablet for tablet 119cab43f5194eeb8fbab9dbcd3886c7 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:40.023052 27486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119cab43f5194eeb8fbab9dbcd3886c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.022986 27620 raft_consensus.cc:359] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.023116 27620 raft_consensus.cc:385] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.023154 27620 raft_consensus.cc:740] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.023257 27620 consensus_queue.cc:260] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.023506 27620 ts_tablet_manager.cc:1434] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:40.023706 27562 tablet_service.cc:1505] Processing CreateTablet for tablet 7acbc965e6da4e8b93ec716a5904f7d5 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251214 21:04:40.023993 27561 tablet_service.cc:1505] Processing CreateTablet for tablet 15b77f7899e246999b61b95f8bf64b4f (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251214 21:04:40.024214 27562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acbc965e6da4e8b93ec716a5904f7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.024367 27624 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: Bootstrap starting.
I20251214 21:04:40.025224 27624 tablet_bootstrap.cc:654] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.025328 27485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acbc965e6da4e8b93ec716a5904f7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.025978 27561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b77f7899e246999b61b95f8bf64b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.026032 27620 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: Bootstrap starting.
I20251214 21:04:40.026216 27624 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: No bootstrap required, opened a new log
I20251214 21:04:40.026284 27624 ts_tablet_manager.cc:1403] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:40.026693 27624 raft_consensus.cc:359] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.026779 27624 raft_consensus.cc:385] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.026809 27624 raft_consensus.cc:740] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.026888 27620 tablet_bootstrap.cc:654] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.026916 27624 consensus_queue.cc:260] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.027164 27624 ts_tablet_manager.cc:1434] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:40.027307 27624 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: Bootstrap starting.
I20251214 21:04:40.028159 27624 tablet_bootstrap.cc:654] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.028337 27561 tablet_service.cc:1505] Processing CreateTablet for tablet 119cab43f5194eeb8fbab9dbcd3886c7 (DEFAULT_TABLE table=dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251214 21:04:40.028462 27620 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: No bootstrap required, opened a new log
I20251214 21:04:40.028693 27620 ts_tablet_manager.cc:1403] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:40.029107 27620 raft_consensus.cc:359] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.029199 27620 raft_consensus.cc:385] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.029227 27620 raft_consensus.cc:740] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.029232 27619 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: No bootstrap required, opened a new log
I20251214 21:04:40.029351 27620 consensus_queue.cc:260] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.029359 27619 ts_tablet_manager.cc:1403] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251214 21:04:40.029579 27561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119cab43f5194eeb8fbab9dbcd3886c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:40.029599 27620 ts_tablet_manager.cc:1434] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:40.029791 27620 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: Bootstrap starting.
I20251214 21:04:40.030680 27620 tablet_bootstrap.cc:654] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.031172 27619 raft_consensus.cc:359] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.031257 27619 raft_consensus.cc:385] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.031287 27619 raft_consensus.cc:740] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.031384 27619 consensus_queue.cc:260] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.031615 27619 ts_tablet_manager.cc:1434] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:40.031620 27620 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: No bootstrap required, opened a new log
I20251214 21:04:40.031739 27620 ts_tablet_manager.cc:1403] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:40.031793 27619 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:40.031919 27624 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: No bootstrap required, opened a new log
I20251214 21:04:40.031997 27624 ts_tablet_manager.cc:1403] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251214 21:04:40.032133 27620 raft_consensus.cc:359] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.032212 27620 raft_consensus.cc:385] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.032262 27620 raft_consensus.cc:740] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.032371 27620 consensus_queue.cc:260] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.032642 27620 ts_tablet_manager.cc:1434] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:40.032666 27619 tablet_bootstrap.cc:654] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.032799 27620 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: Bootstrap starting.
I20251214 21:04:40.033596 27619 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: No bootstrap required, opened a new log
I20251214 21:04:40.033677 27619 ts_tablet_manager.cc:1403] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251214 21:04:40.033747 27620 tablet_bootstrap.cc:654] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.034107 27619 raft_consensus.cc:359] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.034204 27619 raft_consensus.cc:385] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.034236 27619 raft_consensus.cc:740] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.034333 27619 consensus_queue.cc:260] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.034567 27619 ts_tablet_manager.cc:1434] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:40.032372 27624 raft_consensus.cc:359] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.034742 27619 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:40.034768 27620 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: No bootstrap required, opened a new log
I20251214 21:04:40.034864 27620 ts_tablet_manager.cc:1403] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:40.035241 27620 raft_consensus.cc:359] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.035324 27620 raft_consensus.cc:385] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.035354 27620 raft_consensus.cc:740] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.035449 27620 consensus_queue.cc:260] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.035575 27619 tablet_bootstrap.cc:654] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.035701 27620 ts_tablet_manager.cc:1434] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:40.034718 27624 raft_consensus.cc:385] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.036010 27624 raft_consensus.cc:740] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.036170 27624 consensus_queue.cc:260] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.036458 27624 ts_tablet_manager.cc:1434] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251214 21:04:40.036646 27624 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: Bootstrap starting.
I20251214 21:04:40.037503 27624 tablet_bootstrap.cc:654] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.038637 27624 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: No bootstrap required, opened a new log
I20251214 21:04:40.038728 27624 ts_tablet_manager.cc:1403] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:40.039121 27624 raft_consensus.cc:359] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.039198 27624 raft_consensus.cc:385] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.039227 27624 raft_consensus.cc:740] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.039284 27619 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: No bootstrap required, opened a new log
I20251214 21:04:40.039371 27619 ts_tablet_manager.cc:1403] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251214 21:04:40.039331 27624 consensus_queue.cc:260] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.039592 27624 ts_tablet_manager.cc:1434] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:40.039752 27619 raft_consensus.cc:359] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.039841 27619 raft_consensus.cc:385] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.039882 27619 raft_consensus.cc:740] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.039999 27619 consensus_queue.cc:260] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.040253 27619 ts_tablet_manager.cc:1434] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:40.040454 27619 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:40.041268 27619 tablet_bootstrap.cc:654] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:40.042227 27619 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: No bootstrap required, opened a new log
I20251214 21:04:40.042299 27619 ts_tablet_manager.cc:1403] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:40.042651 27619 raft_consensus.cc:359] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.042728 27619 raft_consensus.cc:385] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:40.042757 27619 raft_consensus.cc:740] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:40.042861 27619 consensus_queue.cc:260] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.043078 27619 ts_tablet_manager.cc:1434] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:40.137425 27626 raft_consensus.cc:493] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:40.137562 27626 raft_consensus.cc:515] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.138001 27626 leader_election.cc:290] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:40.138386 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b77f7899e246999b61b95f8bf64b4f" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c" is_pre_election: true
I20251214 21:04:40.138386 27422 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b77f7899e246999b61b95f8bf64b4f" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a" is_pre_election: true
I20251214 21:04:40.138549 27422 raft_consensus.cc:2468] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 0.
I20251214 21:04:40.138549 27498 raft_consensus.cc:2468] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 0.
I20251214 21:04:40.138808 27537 leader_election.cc:304] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, cacfd002884a45f8a129df8020e6ded6; no voters:
I20251214 21:04:40.138957 27626 raft_consensus.cc:2804] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:40.139014 27626 raft_consensus.cc:493] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:40.139060 27626 raft_consensus.cc:3060] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.139925 27626 raft_consensus.cc:515] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.140179 27623 raft_consensus.cc:493] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:40.140244 27626 leader_election.cc:290] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 election: Requested vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:40.140260 27623 raft_consensus.cc:515] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.140602 27422 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b77f7899e246999b61b95f8bf64b4f" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a"
I20251214 21:04:40.140605 27623 leader_election.cc:290] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:40.140736 27422 raft_consensus.cc:3060] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.140844 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7acbc965e6da4e8b93ec716a5904f7d5" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6" is_pre_election: true
I20251214 21:04:40.140856 27497 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7acbc965e6da4e8b93ec716a5904f7d5" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c" is_pre_election: true
I20251214 21:04:40.140931 27573 raft_consensus.cc:2468] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 0.
I20251214 21:04:40.140961 27497 raft_consensus.cc:2468] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 0.
I20251214 21:04:40.141163 27386 leader_election.cc:304] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:40.141311 27623 raft_consensus.cc:2804] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:40.141353 27623 raft_consensus.cc:493] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:40.141378 27623 raft_consensus.cc:3060] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.141651 27422 raft_consensus.cc:2468] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 1.
I20251214 21:04:40.141871 27498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b77f7899e246999b61b95f8bf64b4f" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c"
I20251214 21:04:40.141892 27537 leader_election.cc:304] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, cacfd002884a45f8a129df8020e6ded6; no voters:
I20251214 21:04:40.141986 27498 raft_consensus.cc:3060] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.142066 27626 raft_consensus.cc:2804] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:40.142135 27626 raft_consensus.cc:697] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Becoming Leader. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Running, Role: LEADER
I20251214 21:04:40.142165 27623 raft_consensus.cc:515] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.142252 27626 consensus_queue.cc:237] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.142462 27623 leader_election.cc:290] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 election: Requested vote from peers e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:40.142669 27497 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7acbc965e6da4e8b93ec716a5904f7d5" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c"
I20251214 21:04:40.142752 27497 raft_consensus.cc:3060] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.142817 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7acbc965e6da4e8b93ec716a5904f7d5" candidate_uuid: "9151de528de149029e1ddc479a91632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6"
I20251214 21:04:40.142881 27498 raft_consensus.cc:2468] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 1.
I20251214 21:04:40.142904 27573 raft_consensus.cc:3060] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.143600 27497 raft_consensus.cc:2468] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 1.
I20251214 21:04:40.143756 27573 raft_consensus.cc:2468] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9151de528de149029e1ddc479a91632a in term 1.
I20251214 21:04:40.143846 27386 leader_election.cc:304] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:40.144032 27623 raft_consensus.cc:2804] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:40.144119 27623 raft_consensus.cc:697] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: Becoming Leader. State: Replica: 9151de528de149029e1ddc479a91632a, State: Running, Role: LEADER
I20251214 21:04:40.144224 27623 consensus_queue.cc:237] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.144985 27318 catalog_manager.cc:5654] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cacfd002884a45f8a129df8020e6ded6 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "cacfd002884a45f8a129df8020e6ded6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:40.145745 27319 catalog_manager.cc:5654] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9151de528de149029e1ddc479a91632a (127.20.32.1). New cstate: current_term: 1 leader_uuid: "9151de528de149029e1ddc479a91632a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:40.210254 27631 raft_consensus.cc:493] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:40.210427 27631 raft_consensus.cc:515] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.210919 27631 leader_election.cc:290] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:40.214460 27422 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e47b2e59579c45479dca6982b03b54f8" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a" is_pre_election: true
I20251214 21:04:40.214460 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e47b2e59579c45479dca6982b03b54f8" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6" is_pre_election: true
I20251214 21:04:40.214656 27422 raft_consensus.cc:2468] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 0.
I20251214 21:04:40.214666 27573 raft_consensus.cc:2468] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 0.
I20251214 21:04:40.214991 27463 leader_election.cc:304] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:40.215145 27631 raft_consensus.cc:2804] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:40.215194 27631 raft_consensus.cc:493] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:40.215230 27631 raft_consensus.cc:3060] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.216094 27631 raft_consensus.cc:515] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.216416 27631 leader_election.cc:290] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 1 election: Requested vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:40.216720 27422 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e47b2e59579c45479dca6982b03b54f8" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a"
I20251214 21:04:40.216735 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e47b2e59579c45479dca6982b03b54f8" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6"
I20251214 21:04:40.216835 27422 raft_consensus.cc:3060] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.216868 27573 raft_consensus.cc:3060] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.217605 27422 raft_consensus.cc:2468] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 1.
I20251214 21:04:40.217617 27573 raft_consensus.cc:2468] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 1.
I20251214 21:04:40.217882 27462 leader_election.cc:304] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9151de528de149029e1ddc479a91632a, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:40.218056 27631 raft_consensus.cc:2804] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:40.218132 27631 raft_consensus.cc:697] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 1 LEADER]: Becoming Leader. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Running, Role: LEADER
I20251214 21:04:40.218281 27631 consensus_queue.cc:237] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.219797 27319 catalog_manager.cc:5654] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c reported cstate change: term changed from 0 to 1, leader changed from <none> to e6dae6a96e704090a803841fada0a24c (127.20.32.2). New cstate: current_term: 1 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:40.245420 27626 raft_consensus.cc:493] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:40.245574 27626 raft_consensus.cc:515] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.245998 27626 leader_election.cc:290] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:40.246433 27497 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "119cab43f5194eeb8fbab9dbcd3886c7" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c" is_pre_election: true
I20251214 21:04:40.246452 27422 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "119cab43f5194eeb8fbab9dbcd3886c7" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a" is_pre_election: true
I20251214 21:04:40.246562 27497 raft_consensus.cc:2468] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 0.
I20251214 21:04:40.246574 27422 raft_consensus.cc:2468] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 0.
I20251214 21:04:40.246817 27537 leader_election.cc:304] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:40.246970 27626 raft_consensus.cc:2804] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:40.247030 27626 raft_consensus.cc:493] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:40.247074 27626 raft_consensus.cc:3060] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.247835 27626 raft_consensus.cc:515] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.248118 27626 leader_election.cc:290] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 election: Requested vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:40.248390 27422 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "119cab43f5194eeb8fbab9dbcd3886c7" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a"
I20251214 21:04:40.248445 27497 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "119cab43f5194eeb8fbab9dbcd3886c7" candidate_uuid: "cacfd002884a45f8a129df8020e6ded6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dae6a96e704090a803841fada0a24c"
I20251214 21:04:40.248493 27422 raft_consensus.cc:3060] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.248510 27497 raft_consensus.cc:3060] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:40.249342 27422 raft_consensus.cc:2468] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 1.
I20251214 21:04:40.249342 27497 raft_consensus.cc:2468] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cacfd002884a45f8a129df8020e6ded6 in term 1.
I20251214 21:04:40.249625 27537 leader_election.cc:304] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:40.249791 27626 raft_consensus.cc:2804] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:40.249904 27626 raft_consensus.cc:697] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Becoming Leader. State: Replica: cacfd002884a45f8a129df8020e6ded6, State: Running, Role: LEADER
I20251214 21:04:40.250025 27626 consensus_queue.cc:237] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:40.251441 27319 catalog_manager.cc:5654] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cacfd002884a45f8a129df8020e6ded6 (127.20.32.3). New cstate: current_term: 1 leader_uuid: "cacfd002884a45f8a129df8020e6ded6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:40.261075 20608 tablet_server.cc:178] TabletServer@127.20.32.1:0 shutting down...
I20251214 21:04:40.264079 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:40.264324 20608 tablet_replica.cc:333] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: stopping tablet replica
I20251214 21:04:40.264436 20608 raft_consensus.cc:2243] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:40.264559 20608 pending_rounds.cc:70] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Trying to abort 1 pending ops.
I20251214 21:04:40.264581 20608 pending_rounds.cc:77] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496763472109568 op_type: NO_OP noop_request { }
I20251214 21:04:40.264633 20608 raft_consensus.cc:2889] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:40.264672 20608 raft_consensus.cc:2272] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:40.265221 20608 tablet_replica.cc:333] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: stopping tablet replica
I20251214 21:04:40.265308 20608 raft_consensus.cc:2243] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:40.265376 20608 raft_consensus.cc:2272] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:40.265755 20608 tablet_replica.cc:333] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: stopping tablet replica
I20251214 21:04:40.265833 20608 raft_consensus.cc:2243] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:40.265926 20608 pending_rounds.cc:70] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Trying to abort 1 pending ops.
I20251214 21:04:40.265949 20608 pending_rounds.cc:77] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496762833104896 op_type: NO_OP noop_request { }
I20251214 21:04:40.265990 20608 raft_consensus.cc:2889] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:40.266038 20608 raft_consensus.cc:2272] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:40.266469 20608 tablet_replica.cc:333] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: stopping tablet replica
I20251214 21:04:40.266543 20608 raft_consensus.cc:2243] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:40.266607 20608 raft_consensus.cc:2272] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:40.266887 20608 tablet_replica.cc:333] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: stopping tablet replica
I20251214 21:04:40.266956 20608 raft_consensus.cc:2243] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:40.267048 20608 pending_rounds.cc:70] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Trying to abort 1 pending ops.
I20251214 21:04:40.267071 20608 pending_rounds.cc:77] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496762697875456 op_type: NO_OP noop_request { }
I20251214 21:04:40.267110 20608 raft_consensus.cc:2889] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:40.267145 20608 raft_consensus.cc:2272] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:40.267536 20608 tablet_replica.cc:333] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: stopping tablet replica
I20251214 21:04:40.267603 20608 raft_consensus.cc:2243] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:40.267690 20608 pending_rounds.cc:70] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Trying to abort 1 pending ops.
I20251214 21:04:40.267711 20608 pending_rounds.cc:77] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496762781466624 op_type: NO_OP noop_request { }
I20251214 21:04:40.267747 20608 raft_consensus.cc:2889] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:40.267782 20608 raft_consensus.cc:2272] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:40.268206 20608 tablet_replica.cc:333] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: stopping tablet replica
I20251214 21:04:40.268272 20608 raft_consensus.cc:2243] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:40.268333 20608 raft_consensus.cc:2272] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:40.268606 20608 tablet_replica.cc:333] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: stopping tablet replica
I20251214 21:04:40.268667 20608 raft_consensus.cc:2243] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:40.268728 20608 raft_consensus.cc:2272] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:40.282495 20608 tablet_server.cc:195] TabletServer@127.20.32.1:0 shutdown complete.
I20251214 21:04:40.355417 27626 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:04:40.358968 27537 consensus_peers.cc:597] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 -> Peer 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): Couldn't send request to peer 9151de528de149029e1ddc479a91632a. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:37275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:40.636791 27631 consensus_queue.cc:1048] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:04:40.640030 27462 consensus_peers.cc:597] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c -> Peer 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): Couldn't send request to peer 9151de528de149029e1ddc479a91632a. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:37275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:40.670190 27673 consensus_queue.cc:1048] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:04:40.673426 27537 consensus_peers.cc:597] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 -> Peer 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): Couldn't send request to peer 9151de528de149029e1ddc479a91632a. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:37275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:40.807039 27673 consensus_queue.cc:1048] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:04:40.810833 27537 consensus_peers.cc:597] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 -> Peer 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): Couldn't send request to peer 9151de528de149029e1ddc479a91632a. Status: Network error: Client connection negotiation failed: client connection to 127.20.32.1:37275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:41.249998 27631 consensus_queue.cc:579] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [LEADER]: Leader has been unable to successfully communicate with peer 9151de528de149029e1ddc479a91632a for more than 1 seconds (1.031s)
I20251214 21:04:41.290041 27319 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52142:
table { table_name: "dugtrio" } modify_external_catalogs: true
I20251214 21:04:41.290189 27319 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52142:
table { table_name: "dugtrio" } modify_external_catalogs: true
I20251214 21:04:41.293367 27319 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: Sending DeleteTablet for 3 replicas of tablet e47b2e59579c45479dca6982b03b54f8
I20251214 21:04:41.293686 27319 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: Sending DeleteTablet for 3 replicas of tablet 15b77f7899e246999b61b95f8bf64b4f
I20251214 21:04:41.293938 27319 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: Sending DeleteTablet for 3 replicas of tablet 7acbc965e6da4e8b93ec716a5904f7d5
I20251214 21:04:41.294057 27561 tablet_service.cc:1552] Processing DeleteTablet for tablet e47b2e59579c45479dca6982b03b54f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:43268
I20251214 21:04:41.294152 27319 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: Sending DeleteTablet for 3 replicas of tablet 119cab43f5194eeb8fbab9dbcd3886c7
I20251214 21:04:41.294509 27485 tablet_service.cc:1552] Processing DeleteTablet for tablet e47b2e59579c45479dca6982b03b54f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:58344
I20251214 21:04:41.294656 27487 tablet_service.cc:1552] Processing DeleteTablet for tablet 7acbc965e6da4e8b93ec716a5904f7d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:58344
I20251214 21:04:41.294750 27486 tablet_service.cc:1552] Processing DeleteTablet for tablet 15b77f7899e246999b61b95f8bf64b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:58344
I20251214 21:04:41.294840 27487 tablet_service.cc:1552] Processing DeleteTablet for tablet 119cab43f5194eeb8fbab9dbcd3886c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:58344
I20251214 21:04:41.295040 27562 tablet_service.cc:1552] Processing DeleteTablet for tablet 7acbc965e6da4e8b93ec716a5904f7d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:43268
W20251214 21:04:41.295045 27304 catalog_manager.cc:4712] TS 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 15b77f7899e246999b61b95f8bf64b4f: Network error: Client connection negotiation failed: client connection to 127.20.32.1:37275: connect: Connection refused (error 111)
I20251214 21:04:41.295176 27561 tablet_service.cc:1552] Processing DeleteTablet for tablet 15b77f7899e246999b61b95f8bf64b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:43268
I20251214 21:04:41.295080 27560 tablet_service.cc:1552] Processing DeleteTablet for tablet 119cab43f5194eeb8fbab9dbcd3886c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:43268
I20251214 21:04:41.295290 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251214 21:04:41.295358 27693 tablet_replica.cc:333] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: stopping tablet replica
I20251214 21:04:41.295460 27691 tablet_replica.cc:333] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: stopping tablet replica
I20251214 21:04:41.295531 27693 raft_consensus.cc:2243] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:41.295658 27691 raft_consensus.cc:2243] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.295804 27693 raft_consensus.cc:2272] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.295833 27691 raft_consensus.cc:2272] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.296407 27693 ts_tablet_manager.cc:1916] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.296810 27691 ts_tablet_manager.cc:1916] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251214 21:04:41.296996 27697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:41.297225 27694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:41.297322 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:41.298053 27695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:41.298275 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:41.298326 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:41.298346 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746281298346 us; error 0 us; skew 500 ppm
I20251214 21:04:41.298719 27693 ts_tablet_manager.cc:1929] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251214 21:04:41.298805 27693 log.cc:1199] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/e47b2e59579c45479dca6982b03b54f8
I20251214 21:04:41.299031 27693 ts_tablet_manager.cc:1950] T e47b2e59579c45479dca6982b03b54f8 P e6dae6a96e704090a803841fada0a24c: Deleting consensus metadata
I20251214 21:04:41.299131 27691 ts_tablet_manager.cc:1929] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251214 21:04:41.299191 27691 log.cc:1199] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/e47b2e59579c45479dca6982b03b54f8
I20251214 21:04:41.299374 20608 webserver.cc:492] Webserver started at http://127.20.32.4:40849/ using document root <none> and password file <none>
I20251214 21:04:41.299427 27691 ts_tablet_manager.cc:1950] T e47b2e59579c45479dca6982b03b54f8 P cacfd002884a45f8a129df8020e6ded6: Deleting consensus metadata
I20251214 21:04:41.299499 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:41.299539 20608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:41.299597 20608 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:41.299638 27693 tablet_replica.cc:333] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: stopping tablet replica
I20251214 21:04:41.299726 27304 catalog_manager.cc:4985] TS e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787): tablet e47b2e59579c45479dca6982b03b54f8 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.299757 27693 raft_consensus.cc:2243] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.299846 27693 raft_consensus.cc:2272] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.299922 20608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-3-root/instance:
uuid: "14b3c9e3d50f463ba465b2427ce2f84a"
format_stamp: "Formatted at 2025-12-14 21:04:41 on dist-test-slave-bphs"
I20251214 21:04:41.300031 27305 catalog_manager.cc:4985] TS cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175): tablet e47b2e59579c45479dca6982b03b54f8 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.300069 27691 tablet_replica.cc:333] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: stopping tablet replica
I20251214 21:04:41.300210 27693 ts_tablet_manager.cc:1916] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.300251 27691 raft_consensus.cc:2243] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.300331 27691 raft_consensus.cc:2272] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.300678 27691 ts_tablet_manager.cc:1916] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.301537 20608 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:41.302112 27693 ts_tablet_manager.cc:1929] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251214 21:04:41.302189 27693 log.cc:1199] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/7acbc965e6da4e8b93ec716a5904f7d5
I20251214 21:04:41.302379 27693 ts_tablet_manager.cc:1950] T 7acbc965e6da4e8b93ec716a5904f7d5 P e6dae6a96e704090a803841fada0a24c: Deleting consensus metadata
I20251214 21:04:41.302500 27702 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:41.302558 27691 ts_tablet_manager.cc:1929] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251214 21:04:41.302627 27691 log.cc:1199] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/7acbc965e6da4e8b93ec716a5904f7d5
I20251214 21:04:41.302721 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:41.302812 27691 ts_tablet_manager.cc:1950] T 7acbc965e6da4e8b93ec716a5904f7d5 P cacfd002884a45f8a129df8020e6ded6: Deleting consensus metadata
I20251214 21:04:41.302784 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-3-root
uuid: "14b3c9e3d50f463ba465b2427ce2f84a"
format_stamp: "Formatted at 2025-12-14 21:04:41 on dist-test-slave-bphs"
I20251214 21:04:41.302883 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:41.303069 27304 catalog_manager.cc:4985] TS e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787): tablet 7acbc965e6da4e8b93ec716a5904f7d5 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.303275 27693 tablet_replica.cc:333] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: stopping tablet replica
I20251214 21:04:41.303328 27691 tablet_replica.cc:333] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: stopping tablet replica
I20251214 21:04:41.303388 27693 raft_consensus.cc:2243] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.303401 27691 raft_consensus.cc:2243] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:41.303478 27693 raft_consensus.cc:2272] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.303542 27305 catalog_manager.cc:4985] TS cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175): tablet 7acbc965e6da4e8b93ec716a5904f7d5 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.303551 27691 raft_consensus.cc:2272] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.303989 27693 ts_tablet_manager.cc:1916] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.304276 27691 ts_tablet_manager.cc:1916] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.305940 27693 ts_tablet_manager.cc:1929] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251214 21:04:41.306021 27693 log.cc:1199] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/15b77f7899e246999b61b95f8bf64b4f
I20251214 21:04:41.306020 27691 ts_tablet_manager.cc:1929] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251214 21:04:41.306104 27691 log.cc:1199] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/15b77f7899e246999b61b95f8bf64b4f
I20251214 21:04:41.306294 27693 ts_tablet_manager.cc:1950] T 15b77f7899e246999b61b95f8bf64b4f P e6dae6a96e704090a803841fada0a24c: Deleting consensus metadata
I20251214 21:04:41.306315 27691 ts_tablet_manager.cc:1950] T 15b77f7899e246999b61b95f8bf64b4f P cacfd002884a45f8a129df8020e6ded6: Deleting consensus metadata
I20251214 21:04:41.306912 27691 tablet_replica.cc:333] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: stopping tablet replica
I20251214 21:04:41.306995 27305 catalog_manager.cc:4985] TS cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175): tablet 15b77f7899e246999b61b95f8bf64b4f (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.307055 27691 raft_consensus.cc:2243] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:41.306912 27693 tablet_replica.cc:333] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: stopping tablet replica
I20251214 21:04:41.307091 27304 catalog_manager.cc:4985] TS e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787): tablet 15b77f7899e246999b61b95f8bf64b4f (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.307214 27693 raft_consensus.cc:2243] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.307222 27691 raft_consensus.cc:2272] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.307308 27693 raft_consensus.cc:2272] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.307904 27691 ts_tablet_manager.cc:1916] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.307904 27693 ts_tablet_manager.cc:1916] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.309876 27691 ts_tablet_manager.cc:1929] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251214 21:04:41.309957 27691 log.cc:1199] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/119cab43f5194eeb8fbab9dbcd3886c7
I20251214 21:04:41.309983 27693 ts_tablet_manager.cc:1929] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251214 21:04:41.310035 27693 log.cc:1199] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/119cab43f5194eeb8fbab9dbcd3886c7
I20251214 21:04:41.310213 27691 ts_tablet_manager.cc:1950] T 119cab43f5194eeb8fbab9dbcd3886c7 P cacfd002884a45f8a129df8020e6ded6: Deleting consensus metadata
I20251214 21:04:41.310247 27693 ts_tablet_manager.cc:1950] T 119cab43f5194eeb8fbab9dbcd3886c7 P e6dae6a96e704090a803841fada0a24c: Deleting consensus metadata
I20251214 21:04:41.310915 27304 catalog_manager.cc:4985] TS e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787): tablet 119cab43f5194eeb8fbab9dbcd3886c7 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.311003 27305 catalog_manager.cc:4985] TS cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175): tablet 119cab43f5194eeb8fbab9dbcd3886c7 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.318085 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:41.318444 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:41.318696 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:41.319104 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:41.319142 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:41.319182 20608 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:41.319208 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:41.323110 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.4:43623
I20251214 21:04:41.323722 27765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.4:43623 every 8 connection(s)
I20251214 21:04:41.324023 20608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:41.325802 27769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:41.325803 27770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:41.326155 20608 server_base.cc:1047] running on GCE node
W20251214 21:04:41.325863 27772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:41.326594 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:41.326653 20608 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:41.326675 20608 hybrid_clock.cc:648] HybridClock initialized: now 1765746281326675 us; error 0 us; skew 500 ppm
I20251214 21:04:41.327705 20608 webserver.cc:492] Webserver started at http://127.20.32.1:46613/ using document root <none> and password file <none>
I20251214 21:04:41.327879 20608 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:41.327921 20608 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251214 21:04:41.328449 27766 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43059
I20251214 21:04:41.328540 27766 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:41.328754 27766 heartbeater.cc:507] Master 127.20.32.62:43059 requested a full tablet report, sending...
I20251214 21:04:41.328895 20608 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:41.329360 27319 ts_manager.cc:194] Registered new tserver with Master: 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4:43623)
I20251214 21:04:41.330024 27319 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52178
I20251214 21:04:41.330190 27777 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:41.330427 20608 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:41.330497 20608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root
uuid: "9151de528de149029e1ddc479a91632a"
format_stamp: "Formatted at 2025-12-14 21:04:38 on dist-test-slave-bphs"
I20251214 21:04:41.330562 20608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:41.335264 20608 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:41.335547 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:41.335786 20608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:41.336364 27784 ts_tablet_manager.cc:542] Loading tablet metadata (0/8 complete)
I20251214 21:04:41.341820 20608 ts_tablet_manager.cc:585] Loaded tablet metadata (8 total tablets, 8 live tablets)
I20251214 21:04:41.341895 20608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20251214 21:04:41.341946 20608 ts_tablet_manager.cc:600] Registering tablets (0/8 complete)
I20251214 21:04:41.342748 27784 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:41.345315 27784 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251214 21:04:41.345602 27784 tablet_bootstrap.cc:492] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Bootstrap complete.
I20251214 21:04:41.345809 27784 ts_tablet_manager.cc:1403] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20251214 21:04:41.345937 20608 ts_tablet_manager.cc:616] Registered 8 tablets
I20251214 21:04:41.345989 20608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.004s sys 0.000s
I20251214 21:04:41.346203 27784 raft_consensus.cc:359] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.346335 27784 raft_consensus.cc:740] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:41.346460 27784 consensus_queue.cc:260] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.346781 27784 ts_tablet_manager.cc:1434] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251214 21:04:41.346932 27784 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:41.348948 27784 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251214 21:04:41.349193 27784 tablet_bootstrap.cc:492] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Bootstrap complete.
I20251214 21:04:41.349334 27784 ts_tablet_manager.cc:1403] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251214 21:04:41.349643 27784 raft_consensus.cc:359] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.349808 27784 raft_consensus.cc:740] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:41.349941 27784 consensus_queue.cc:260] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.350203 27784 ts_tablet_manager.cc:1434] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:41.350335 27784 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:41.350800 20608 rpc_server.cc:307] RPC server started. Bound to: 127.20.32.1:37275
I20251214 21:04:41.350847 27844 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.32.1:37275 every 8 connection(s)
I20251214 21:04:41.352398 27784 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:41.352615 27784 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Bootstrap complete.
I20251214 21:04:41.352768 27784 ts_tablet_manager.cc:1403] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:41.353111 27784 raft_consensus.cc:359] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.353214 27784 raft_consensus.cc:740] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:41.353363 27784 consensus_queue.cc:260] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.353585 27784 ts_tablet_manager.cc:1434] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:41.353760 27784 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:41.356165 27784 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251214 21:04:41.356392 27845 heartbeater.cc:344] Connected to a master server at 127.20.32.62:43059
I20251214 21:04:41.356451 27784 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Bootstrap complete.
I20251214 21:04:41.356498 27845 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:41.356514 27673 consensus_queue.cc:579] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Leader has been unable to successfully communicate with peer 9151de528de149029e1ddc479a91632a for more than 1 seconds (1.427s)
I20251214 21:04:41.356597 27784 ts_tablet_manager.cc:1403] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:41.356737 27845 heartbeater.cc:507] Master 127.20.32.62:43059 requested a full tablet report, sending...
I20251214 21:04:41.356949 27784 raft_consensus.cc:359] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.357074 27784 raft_consensus.cc:740] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:41.357220 27784 consensus_queue.cc:260] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.357476 27784 ts_tablet_manager.cc:1434] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:41.357628 27784 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:41.357900 27319 ts_manager.cc:194] Re-registered known tserver with Master: 9151de528de149029e1ddc479a91632a (127.20.32.1:37275)
I20251214 21:04:41.359527 27573 consensus_queue.cc:237] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:41.359760 27319 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52182
I20251214 21:04:41.360594 27808 tablet_service.cc:1552] Processing DeleteTablet for tablet 15b77f7899e246999b61b95f8bf64b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:53680
I20251214 21:04:41.361390 27845 heartbeater.cc:499] Master 127.20.32.62:43059 was elected leader, sending a full tablet report...
I20251214 21:04:41.361485 27497 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:04:41.361922 27855 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20251214 21:04:41.361997 27304 catalog_manager.cc:4965] TS 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): delete failed for tablet 15b77f7899e246999b61b95f8bf64b4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b77f7899e246999b61b95f8bf64b4f already in progress: opening tablet
I20251214 21:04:41.362457 27784 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:41.362681 27784 tablet_bootstrap.cc:492] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Bootstrap complete.
I20251214 21:04:41.362861 27784 ts_tablet_manager.cc:1403] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251214 21:04:41.363201 27784 raft_consensus.cc:359] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.363296 27784 raft_consensus.cc:740] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:41.363409 27784 consensus_queue.cc:260] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.363644 27784 ts_tablet_manager.cc:1434] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:41.363809 27784 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:41.363703 27851 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:41.364339 27808 tablet_service.cc:1552] Processing DeleteTablet for tablet 15b77f7899e246999b61b95f8bf64b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:53680
I20251214 21:04:41.364243 27497 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:41.365342 27305 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet bac0097611aa492ab9588fa41e5c25ee with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251214 21:04:41.365899 27318 catalog_manager.cc:5654] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 reported cstate change: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "cacfd002884a45f8a129df8020e6ded6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:41.366015 27856 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:41.366143 27856 raft_consensus.cc:2243] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.366240 27856 raft_consensus.cc:2272] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.366766 27856 ts_tablet_manager.cc:1916] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.368983 27856 ts_tablet_manager.cc:1929] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251214 21:04:41.369074 27856 log.cc:1199] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/15b77f7899e246999b61b95f8bf64b4f
I20251214 21:04:41.369302 27856 ts_tablet_manager.cc:1950] T 15b77f7899e246999b61b95f8bf64b4f P 9151de528de149029e1ddc479a91632a: Deleting consensus metadata
I20251214 21:04:41.369668 27818 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:04:41.370049 27808 tablet_service.cc:1552] Processing DeleteTablet for tablet 7acbc965e6da4e8b93ec716a5904f7d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:53680
I20251214 21:04:41.370591 27856 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:41.370680 27304 catalog_manager.cc:4985] TS 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): tablet 15b77f7899e246999b61b95f8bf64b4f (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.370747 27856 raft_consensus.cc:2243] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.370828 27856 pending_rounds.cc:70] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Trying to abort 1 pending ops.
I20251214 21:04:41.370858 27856 pending_rounds.cc:77] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232496763472109568 op_type: NO_OP noop_request { }
I20251214 21:04:41.370913 27856 raft_consensus.cc:2889] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251214 21:04:41.370963 27856 raft_consensus.cc:2272] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.371089 27855 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:04:41.371299 27784 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251214 21:04:41.371575 27784 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Bootstrap complete.
I20251214 21:04:41.371730 27784 ts_tablet_manager.cc:1403] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251214 21:04:41.371788 27856 ts_tablet_manager.cc:1916] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.371892 27818 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:41.372145 27784 raft_consensus.cc:359] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.372243 27784 raft_consensus.cc:740] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:41.372357 27784 consensus_queue.cc:260] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.372654 27784 ts_tablet_manager.cc:1434] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:41.372800 27784 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:41.373553 27856 ts_tablet_manager.cc:1929] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20251214 21:04:41.373591 27537 consensus_peers.cc:597] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 -> Peer 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4:43623): Couldn't send request to peer 14b3c9e3d50f463ba465b2427ce2f84a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bac0097611aa492ab9588fa41e5c25ee. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:41.373611 27856 log.cc:1199] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/7acbc965e6da4e8b93ec716a5904f7d5
I20251214 21:04:41.373907 27856 ts_tablet_manager.cc:1950] T 7acbc965e6da4e8b93ec716a5904f7d5 P 9151de528de149029e1ddc479a91632a: Deleting consensus metadata
I20251214 21:04:41.374497 27304 catalog_manager.cc:4985] TS 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): tablet 7acbc965e6da4e8b93ec716a5904f7d5 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.375435 27784 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:41.375664 27784 tablet_bootstrap.cc:492] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Bootstrap complete.
I20251214 21:04:41.375833 27784 ts_tablet_manager.cc:1403] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:41.376231 27784 raft_consensus.cc:359] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.376319 27784 raft_consensus.cc:740] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:41.376441 27784 consensus_queue.cc:260] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.376665 27784 ts_tablet_manager.cc:1434] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:41.376825 27784 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Bootstrap starting.
I20251214 21:04:41.379498 27784 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:41.379688 27784 tablet_bootstrap.cc:492] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Bootstrap complete.
I20251214 21:04:41.379820 27784 ts_tablet_manager.cc:1403] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:41.380177 27784 raft_consensus.cc:359] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.380271 27784 raft_consensus.cc:740] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9151de528de149029e1ddc479a91632a, State: Initialized, Role: FOLLOWER
I20251214 21:04:41.380360 27784 consensus_queue.cc:260] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.380596 27784 ts_tablet_manager.cc:1434] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:41.385133 27808 tablet_service.cc:1552] Processing DeleteTablet for tablet e47b2e59579c45479dca6982b03b54f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:53680
I20251214 21:04:41.385344 27856 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:41.385459 27856 raft_consensus.cc:2243] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.385550 27856 raft_consensus.cc:2272] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.386089 27856 ts_tablet_manager.cc:1916] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.388005 27856 ts_tablet_manager.cc:1929] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251214 21:04:41.388072 27856 log.cc:1199] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/e47b2e59579c45479dca6982b03b54f8
I20251214 21:04:41.388221 27856 ts_tablet_manager.cc:1950] T e47b2e59579c45479dca6982b03b54f8 P 9151de528de149029e1ddc479a91632a: Deleting consensus metadata
I20251214 21:04:41.389029 27304 catalog_manager.cc:4985] TS 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): tablet e47b2e59579c45479dca6982b03b54f8 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.396786 27808 tablet_service.cc:1552] Processing DeleteTablet for tablet 119cab43f5194eeb8fbab9dbcd3886c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:04:41 UTC) from {username='slave'} at 127.0.0.1:53680
I20251214 21:04:41.397002 27856 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:41.397120 27856 raft_consensus.cc:2243] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:41.397215 27856 raft_consensus.cc:2272] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:41.397683 27856 ts_tablet_manager.cc:1916] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:04:41.399391 27856 ts_tablet_manager.cc:1929] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251214 21:04:41.399453 27856 log.cc:1199] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/119cab43f5194eeb8fbab9dbcd3886c7
I20251214 21:04:41.399591 27856 ts_tablet_manager.cc:1950] T 119cab43f5194eeb8fbab9dbcd3886c7 P 9151de528de149029e1ddc479a91632a: Deleting consensus metadata
I20251214 21:04:41.400334 27304 catalog_manager.cc:4985] TS 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): tablet 119cab43f5194eeb8fbab9dbcd3886c7 (table dugtrio [id=3eccee68e52b4d2b9bb01d0f956818c1]) successfully deleted
I20251214 21:04:41.538111 27681 raft_consensus.cc:493] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:41.538285 27681 raft_consensus.cc:515] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.538739 27681 leader_election.cc:290] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:41.539208 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6b77cc1d2e4434a8b5a23ed5d786aa7" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6" is_pre_election: true
I20251214 21:04:41.539347 27573 raft_consensus.cc:2468] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 1.
I20251214 21:04:41.539628 27463 leader_election.cc:304] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:41.539783 27681 raft_consensus.cc:2804] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:41.539842 27681 raft_consensus.cc:493] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:41.539887 27681 raft_consensus.cc:3060] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.540906 27681 raft_consensus.cc:515] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.541273 27681 leader_election.cc:290] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 election: Requested vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:41.541575 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6b77cc1d2e4434a8b5a23ed5d786aa7" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6"
I20251214 21:04:41.541683 27573 raft_consensus.cc:3060] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.542429 27818 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6b77cc1d2e4434a8b5a23ed5d786aa7" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a" is_pre_election: true
I20251214 21:04:41.542512 27819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6b77cc1d2e4434a8b5a23ed5d786aa7" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a"
I20251214 21:04:41.542558 27818 raft_consensus.cc:2410] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6dae6a96e704090a803841fada0a24c for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:41.542587 27573 raft_consensus.cc:2468] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 2.
I20251214 21:04:41.542882 27463 leader_election.cc:304] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:41.543020 27681 raft_consensus.cc:2804] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:41.543105 27681 raft_consensus.cc:697] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Becoming Leader. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Running, Role: LEADER
I20251214 21:04:41.543226 27681 consensus_queue.cc:237] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.544710 27319 catalog_manager.cc:5654] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c reported cstate change: term changed from 1 to 2, leader changed from 9151de528de149029e1ddc479a91632a (127.20.32.1) to e6dae6a96e704090a803841fada0a24c (127.20.32.2). New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:41.700575 27367 auto_rebalancer.cc:253] failed to send replica move request: Invalid argument: Server with UUID 14b3c9e3d50f463ba465b2427ce2f84a is already a member of the config. RaftConfig: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
W20251214 21:04:41.701469 27367 auto_rebalancer.cc:663] Could not move replica: Illegal state: bac0097611aa492ab9588fa41e5c25ee: source replica e6dae6a96e704090a803841fada0a24c does not have REPLACE attribute set
W20251214 21:04:41.701519 27367 auto_rebalancer.cc:263] scheduled replica move failed to complete: Illegal state: bac0097611aa492ab9588fa41e5c25ee: source replica e6dae6a96e704090a803841fada0a24c does not have REPLACE attribute set
W20251214 21:04:41.702316 27367 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 46988503d5024be48fb69a2b1d4536b1, TS cacfd002884a45f8a129df8020e6ded6 -> TS 14b3c9e3d50f463ba465b2427ce2f84a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
W20251214 21:04:41.702361 27367 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet 46988503d5024be48fb69a2b1d4536b1, TS cacfd002884a45f8a129df8020e6ded6 -> TS 14b3c9e3d50f463ba465b2427ce2f84a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
W20251214 21:04:41.703153 27367 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet b6b77cc1d2e4434a8b5a23ed5d786aa7, TS 9151de528de149029e1ddc479a91632a -> TS 14b3c9e3d50f463ba465b2427ce2f84a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
W20251214 21:04:41.703197 27367 auto_rebalancer.cc:263] scheduled replica move failed to complete: Incomplete: tablet b6b77cc1d2e4434a8b5a23ed5d786aa7, TS 9151de528de149029e1ddc479a91632a -> TS 14b3c9e3d50f463ba465b2427ce2f84a move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.721755 27681 raft_consensus.cc:493] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:41.721940 27681 raft_consensus.cc:515] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.722412 27681 leader_election.cc:290] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:41.722873 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25ada40c9f8d4da99eda6d54daad418c" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6" is_pre_election: true
I20251214 21:04:41.722870 27819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25ada40c9f8d4da99eda6d54daad418c" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a" is_pre_election: true
I20251214 21:04:41.723049 27819 raft_consensus.cc:2410] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6dae6a96e704090a803841fada0a24c for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:41.723014 27573 raft_consensus.cc:2468] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 1.
I20251214 21:04:41.723327 27463 leader_election.cc:304] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:41.723489 27681 raft_consensus.cc:2804] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:41.723541 27681 raft_consensus.cc:493] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:41.723574 27681 raft_consensus.cc:3060] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.724435 27681 raft_consensus.cc:515] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.724771 27681 leader_election.cc:290] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 election: Requested vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:41.725220 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25ada40c9f8d4da99eda6d54daad418c" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6"
I20251214 21:04:41.725220 27819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25ada40c9f8d4da99eda6d54daad418c" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a"
I20251214 21:04:41.725361 27573 raft_consensus.cc:3060] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.725361 27819 raft_consensus.cc:3060] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.726373 27573 raft_consensus.cc:2468] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 2.
I20251214 21:04:41.726585 27819 raft_consensus.cc:2410] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e6dae6a96e704090a803841fada0a24c for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:41.726679 27463 leader_election.cc:304] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:41.726841 27681 raft_consensus.cc:2804] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:41.726919 27681 raft_consensus.cc:697] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Becoming Leader. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Running, Role: LEADER
I20251214 21:04:41.727046 27681 consensus_queue.cc:237] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.728489 27319 catalog_manager.cc:5654] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c reported cstate change: term changed from 1 to 2, leader changed from 9151de528de149029e1ddc479a91632a (127.20.32.1) to e6dae6a96e704090a803841fada0a24c (127.20.32.2). New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:41.762900 27870 ts_tablet_manager.cc:933] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Initiating tablet copy from peer cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:41.763206 27870 tablet_copy_client.cc:323] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:33175
I20251214 21:04:41.766309 27581 tablet_copy_service.cc:140] P cacfd002884a45f8a129df8020e6ded6: Received BeginTabletCopySession request for tablet bac0097611aa492ab9588fa41e5c25ee from peer 14b3c9e3d50f463ba465b2427ce2f84a ({username='slave'} at 127.0.0.1:43304)
I20251214 21:04:41.766415 27581 tablet_copy_service.cc:161] P cacfd002884a45f8a129df8020e6ded6: Beginning new tablet copy session on tablet bac0097611aa492ab9588fa41e5c25ee from peer 14b3c9e3d50f463ba465b2427ce2f84a at {username='slave'} at 127.0.0.1:43304: session id = 14b3c9e3d50f463ba465b2427ce2f84a-bac0097611aa492ab9588fa41e5c25ee
I20251214 21:04:41.767169 27581 tablet_copy_source_session.cc:215] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:41.767932 27870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac0097611aa492ab9588fa41e5c25ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:41.769820 27870 tablet_copy_client.cc:806] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:41.769980 27870 tablet_copy_client.cc:670] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:41.771083 27870 tablet_copy_client.cc:538] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:41.772194 27870 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap starting.
I20251214 21:04:41.774482 27573 consensus_queue.cc:237] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.775604 27819 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:04:41.775653 27497 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20251214 21:04:41.775913 27870 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:41.775923 27851 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:41.776156 27870 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap complete.
I20251214 21:04:41.776212 27673 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:41.776320 27870 ts_tablet_manager.cc:1403] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:04:41.776767 27870 raft_consensus.cc:359] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:41.776856 27870 raft_consensus.cc:740] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 14b3c9e3d50f463ba465b2427ce2f84a, State: Initialized, Role: LEARNER
I20251214 21:04:41.776940 27870 consensus_queue.cc:260] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:41.777418 27766 heartbeater.cc:499] Master 127.20.32.62:43059 was elected leader, sending a full tablet report...
I20251214 21:04:41.777427 27870 ts_tablet_manager.cc:1434] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:04:41.777976 27855 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } }
I20251214 21:04:41.778316 27581 tablet_copy_service.cc:342] P cacfd002884a45f8a129df8020e6ded6: Request end of tablet copy session 14b3c9e3d50f463ba465b2427ce2f84a-bac0097611aa492ab9588fa41e5c25ee received from {username='slave'} at 127.0.0.1:43304
I20251214 21:04:41.778440 27581 tablet_copy_service.cc:434] P cacfd002884a45f8a129df8020e6ded6: ending tablet copy session 14b3c9e3d50f463ba465b2427ce2f84a-bac0097611aa492ab9588fa41e5c25ee on tablet bac0097611aa492ab9588fa41e5c25ee with peer 14b3c9e3d50f463ba465b2427ce2f84a
I20251214 21:04:41.778491 27497 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } }
I20251214 21:04:41.779491 27305 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet bac0097611aa492ab9588fa41e5c25ee with cas_config_opid_index 2: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:04:41.780339 27819 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } }
I20251214 21:04:41.780468 27318 catalog_manager.cc:5654] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c reported cstate change: config changed from index 2 to 3, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) evicted. New cstate: current_term: 1 leader_uuid: "cacfd002884a45f8a129df8020e6ded6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } }
I20251214 21:04:41.785607 27730 tablet_service.cc:1552] Processing DeleteTablet for tablet bac0097611aa492ab9588fa41e5c25ee with delete_type TABLET_DATA_TOMBSTONED (TS 14b3c9e3d50f463ba465b2427ce2f84a not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:42830
I20251214 21:04:41.785992 27875 tablet_replica.cc:333] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: stopping tablet replica
I20251214 21:04:41.786103 27875 raft_consensus.cc:2243] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 LEARNER]: Raft consensus shutting down.
I20251214 21:04:41.786204 27875 raft_consensus.cc:2272] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 LEARNER]: Raft consensus is shut down!
I20251214 21:04:41.786664 27875 ts_tablet_manager.cc:1916] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:04:41.788362 27875 ts_tablet_manager.cc:1929] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20251214 21:04:41.788425 27875 log.cc:1199] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-3-root/wals/bac0097611aa492ab9588fa41e5c25ee
I20251214 21:04:41.788899 27304 catalog_manager.cc:4985] TS 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4:43623): tablet bac0097611aa492ab9588fa41e5c25ee (table test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]) successfully deleted
I20251214 21:04:41.857832 27681 raft_consensus.cc:493] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:41.857985 27681 raft_consensus.cc:515] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.858397 27681 leader_election.cc:290] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:41.858805 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46988503d5024be48fb69a2b1d4536b1" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6" is_pre_election: true
I20251214 21:04:41.858803 27819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46988503d5024be48fb69a2b1d4536b1" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a" is_pre_election: true
I20251214 21:04:41.858938 27573 raft_consensus.cc:2468] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 1.
I20251214 21:04:41.858978 27819 raft_consensus.cc:2410] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6dae6a96e704090a803841fada0a24c for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:41.859200 27463 leader_election.cc:304] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:41.859419 27681 raft_consensus.cc:2804] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:04:41.859469 27681 raft_consensus.cc:493] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:41.859506 27681 raft_consensus.cc:3060] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.860347 27681 raft_consensus.cc:515] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.860659 27681 leader_election.cc:290] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 election: Requested vote from peers 9151de528de149029e1ddc479a91632a (127.20.32.1:37275), cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:41.860952 27573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46988503d5024be48fb69a2b1d4536b1" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacfd002884a45f8a129df8020e6ded6"
I20251214 21:04:41.860960 27819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46988503d5024be48fb69a2b1d4536b1" candidate_uuid: "e6dae6a96e704090a803841fada0a24c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9151de528de149029e1ddc479a91632a"
I20251214 21:04:41.861058 27573 raft_consensus.cc:3060] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.861076 27819 raft_consensus.cc:3060] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.861794 27573 raft_consensus.cc:2468] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6dae6a96e704090a803841fada0a24c in term 2.
I20251214 21:04:41.861891 27819 raft_consensus.cc:2410] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e6dae6a96e704090a803841fada0a24c for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251214 21:04:41.862032 27463 leader_election.cc:304] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cacfd002884a45f8a129df8020e6ded6, e6dae6a96e704090a803841fada0a24c; no voters:
I20251214 21:04:41.862182 27681 raft_consensus.cc:2804] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:41.862273 27681 raft_consensus.cc:697] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Becoming Leader. State: Replica: e6dae6a96e704090a803841fada0a24c, State: Running, Role: LEADER
I20251214 21:04:41.862399 27681 consensus_queue.cc:237] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } }
I20251214 21:04:41.863737 27319 catalog_manager.cc:5654] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c reported cstate change: term changed from 1 to 2, leader changed from 9151de528de149029e1ddc479a91632a (127.20.32.1) to e6dae6a96e704090a803841fada0a24c (127.20.32.2). New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:41.938537 27573 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251214 21:04:41.939002 27681 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:41.941254 27819 raft_consensus.cc:3060] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:41.942386 27819 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20251214 21:04:41.942452 27819 pending_rounds.cc:85] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Aborting all ops after (but not including) 0
I20251214 21:04:41.942476 27819 pending_rounds.cc:107] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20251214 21:04:41.942507 27819 raft_consensus.cc:2889] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251214 21:04:41.942847 27681 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:42.120682 27819 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20251214 21:04:42.120785 27819 pending_rounds.cc:85] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Aborting all ops after (but not including) 0
I20251214 21:04:42.120811 27819 pending_rounds.cc:107] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20251214 21:04:42.120836 27819 raft_consensus.cc:2889] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251214 21:04:42.121224 27681 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:42.123469 27573 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251214 21:04:42.123870 27681 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:42.419934 27573 raft_consensus.cc:1275] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251214 21:04:42.420326 27681 consensus_queue.cc:1048] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:42.423007 27819 raft_consensus.cc:1275] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20251214 21:04:42.423079 27819 pending_rounds.cc:85] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Aborting all ops after (but not including) 0
I20251214 21:04:42.423102 27819 pending_rounds.cc:107] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20251214 21:04:42.423125 27819 raft_consensus.cc:2889] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251214 21:04:42.423497 27883 consensus_queue.cc:1048] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:42.708796 27497 consensus_queue.cc:237] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:42.710088 27819 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251214 21:04:42.710088 27573 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251214 21:04:42.710474 27883 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:04:42.710729 27681 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:04:42.712193 27681 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:42.712631 27573 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
W20251214 21:04:42.714659 27462 consensus_peers.cc:597] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c -> Peer 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4:43623): Couldn't send request to peer 14b3c9e3d50f463ba465b2427ce2f84a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6b77cc1d2e4434a8b5a23ed5d786aa7. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:42.714648 27573 consensus_queue.cc:237] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:42.715205 27819 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:42.714694 27318 catalog_manager.cc:5654] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c reported cstate change: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:42.716001 27818 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20251214 21:04:42.716073 27537 consensus_peers.cc:597] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 -> Peer 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4:43623): Couldn't send request to peer 14b3c9e3d50f463ba465b2427ce2f84a. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:42.716742 27892 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:42.717422 27497 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20251214 21:04:42.717816 27892 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:42.718587 27892 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:42.719048 27819 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:42.719717 27497 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:42.721276 27317 catalog_manager.cc:5654] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 reported cstate change: config changed from index 3 to 4, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New cstate: current_term: 1 leader_uuid: "cacfd002884a45f8a129df8020e6ded6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:42.721973 27497 consensus_queue.cc:237] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:42.723035 27819 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251214 21:04:42.723155 27573 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251214 21:04:42.723233 27462 consensus_peers.cc:597] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c -> Peer 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4:43623): Couldn't send request to peer 14b3c9e3d50f463ba465b2427ce2f84a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25ada40c9f8d4da99eda6d54daad418c. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:42.723387 27631 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:04:42.723671 27631 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:04:42.724776 27883 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:42.725124 27819 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:42.726469 27573 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } } }
I20251214 21:04:42.727738 27318 catalog_manager.cc:5654] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c reported cstate change: config changed from index -1 to 2, NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) added. New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:43.121719 27898 ts_tablet_manager.cc:933] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: Initiating tablet copy from peer e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:43.122044 27898 tablet_copy_client.cc:323] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:37787
I20251214 21:04:43.125753 27508 tablet_copy_service.cc:140] P e6dae6a96e704090a803841fada0a24c: Received BeginTabletCopySession request for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 from peer 14b3c9e3d50f463ba465b2427ce2f84a ({username='slave'} at 127.0.0.1:58390)
I20251214 21:04:43.125873 27508 tablet_copy_service.cc:161] P e6dae6a96e704090a803841fada0a24c: Beginning new tablet copy session on tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 from peer 14b3c9e3d50f463ba465b2427ce2f84a at {username='slave'} at 127.0.0.1:58390: session id = 14b3c9e3d50f463ba465b2427ce2f84a-b6b77cc1d2e4434a8b5a23ed5d786aa7
I20251214 21:04:43.126802 27508 tablet_copy_source_session.cc:215] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:43.127739 27898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:43.130020 27898 tablet_copy_client.cc:806] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:43.130182 27898 tablet_copy_client.cc:670] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:43.131193 27898 tablet_copy_client.cc:538] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:43.132588 27898 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap starting.
I20251214 21:04:43.136693 27898 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:43.136957 27898 tablet_bootstrap.cc:492] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap complete.
I20251214 21:04:43.137156 27898 ts_tablet_manager.cc:1403] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20251214 21:04:43.137596 27898 raft_consensus.cc:359] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:43.137760 27898 raft_consensus.cc:740] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 14b3c9e3d50f463ba465b2427ce2f84a, State: Initialized, Role: LEARNER
I20251214 21:04:43.137862 27898 consensus_queue.cc:260] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:43.138248 27898 ts_tablet_manager.cc:1434] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:04:43.138779 27508 tablet_copy_service.cc:342] P e6dae6a96e704090a803841fada0a24c: Request end of tablet copy session 14b3c9e3d50f463ba465b2427ce2f84a-b6b77cc1d2e4434a8b5a23ed5d786aa7 received from {username='slave'} at 127.0.0.1:58390
I20251214 21:04:43.138864 27508 tablet_copy_service.cc:434] P e6dae6a96e704090a803841fada0a24c: ending tablet copy session 14b3c9e3d50f463ba465b2427ce2f84a-b6b77cc1d2e4434a8b5a23ed5d786aa7 on tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 with peer 14b3c9e3d50f463ba465b2427ce2f84a
I20251214 21:04:43.210893 27898 ts_tablet_manager.cc:933] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Initiating tablet copy from peer cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175)
I20251214 21:04:43.211272 27898 tablet_copy_client.cc:323] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.3:33175
I20251214 21:04:43.211659 27581 tablet_copy_service.cc:140] P cacfd002884a45f8a129df8020e6ded6: Received BeginTabletCopySession request for tablet bac0097611aa492ab9588fa41e5c25ee from peer 14b3c9e3d50f463ba465b2427ce2f84a ({username='slave'} at 127.0.0.1:43304)
I20251214 21:04:43.211758 27581 tablet_copy_service.cc:161] P cacfd002884a45f8a129df8020e6ded6: Beginning new tablet copy session on tablet bac0097611aa492ab9588fa41e5c25ee from peer 14b3c9e3d50f463ba465b2427ce2f84a at {username='slave'} at 127.0.0.1:43304: session id = 14b3c9e3d50f463ba465b2427ce2f84a-bac0097611aa492ab9588fa41e5c25ee
I20251214 21:04:43.212755 27581 tablet_copy_source_session.cc:215] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:43.213363 27898 ts_tablet_manager.cc:1916] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Deleting tablet data with delete state TABLET_DATA_COPYING
I20251214 21:04:43.215559 27898 ts_tablet_manager.cc:1929] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.2
I20251214 21:04:43.215731 27898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac0097611aa492ab9588fa41e5c25ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:43.216745 27898 tablet_copy_client.cc:806] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:43.216861 27898 tablet_copy_client.cc:670] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:43.217841 27898 tablet_copy_client.cc:538] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:43.218927 27898 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap starting.
I20251214 21:04:43.222774 27898 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:43.222993 27898 tablet_bootstrap.cc:492] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap complete.
I20251214 21:04:43.223160 27898 ts_tablet_manager.cc:1403] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20251214 21:04:43.223539 27898 raft_consensus.cc:359] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:43.223649 27898 raft_consensus.cc:740] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 14b3c9e3d50f463ba465b2427ce2f84a, State: Initialized, Role: LEARNER
I20251214 21:04:43.223747 27898 consensus_queue.cc:260] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:43.224023 27898 ts_tablet_manager.cc:1434] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251214 21:04:43.224422 27581 tablet_copy_service.cc:342] P cacfd002884a45f8a129df8020e6ded6: Request end of tablet copy session 14b3c9e3d50f463ba465b2427ce2f84a-bac0097611aa492ab9588fa41e5c25ee received from {username='slave'} at 127.0.0.1:43304
I20251214 21:04:43.224488 27581 tablet_copy_service.cc:434] P cacfd002884a45f8a129df8020e6ded6: ending tablet copy session 14b3c9e3d50f463ba465b2427ce2f84a-bac0097611aa492ab9588fa41e5c25ee on tablet bac0097611aa492ab9588fa41e5c25ee with peer 14b3c9e3d50f463ba465b2427ce2f84a
I20251214 21:04:43.280164 27898 ts_tablet_manager.cc:933] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: Initiating tablet copy from peer e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787)
I20251214 21:04:43.280514 27898 tablet_copy_client.cc:323] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Beginning tablet copy session from remote peer at address 127.20.32.2:37787
I20251214 21:04:43.280910 27508 tablet_copy_service.cc:140] P e6dae6a96e704090a803841fada0a24c: Received BeginTabletCopySession request for tablet 25ada40c9f8d4da99eda6d54daad418c from peer 14b3c9e3d50f463ba465b2427ce2f84a ({username='slave'} at 127.0.0.1:58390)
I20251214 21:04:43.281010 27508 tablet_copy_service.cc:161] P e6dae6a96e704090a803841fada0a24c: Beginning new tablet copy session on tablet 25ada40c9f8d4da99eda6d54daad418c from peer 14b3c9e3d50f463ba465b2427ce2f84a at {username='slave'} at 127.0.0.1:58390: session id = 14b3c9e3d50f463ba465b2427ce2f84a-25ada40c9f8d4da99eda6d54daad418c
I20251214 21:04:43.282028 27508 tablet_copy_source_session.cc:215] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:43.282800 27898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ada40c9f8d4da99eda6d54daad418c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:43.284904 27898 tablet_copy_client.cc:806] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:43.285041 27898 tablet_copy_client.cc:670] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:43.286020 27898 tablet_copy_client.cc:538] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:43.287259 27898 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap starting.
I20251214 21:04:43.290076 27898 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:43.290342 27898 tablet_bootstrap.cc:492] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: Bootstrap complete.
I20251214 21:04:43.290503 27898 ts_tablet_manager.cc:1403] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.002s
I20251214 21:04:43.290861 27898 raft_consensus.cc:359] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:43.290987 27898 raft_consensus.cc:740] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 14b3c9e3d50f463ba465b2427ce2f84a, State: Initialized, Role: LEARNER
I20251214 21:04:43.291082 27898 consensus_queue.cc:260] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: NON_VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: true } }
I20251214 21:04:43.291347 27898 ts_tablet_manager.cc:1434] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:43.291777 27508 tablet_copy_service.cc:342] P e6dae6a96e704090a803841fada0a24c: Request end of tablet copy session 14b3c9e3d50f463ba465b2427ce2f84a-25ada40c9f8d4da99eda6d54daad418c received from {username='slave'} at 127.0.0.1:58390
I20251214 21:04:43.291857 27508 tablet_copy_service.cc:434] P e6dae6a96e704090a803841fada0a24c: ending tablet copy session 14b3c9e3d50f463ba465b2427ce2f84a-25ada40c9f8d4da99eda6d54daad418c on tablet 25ada40c9f8d4da99eda6d54daad418c with peer 14b3c9e3d50f463ba465b2427ce2f84a
I20251214 21:04:43.499065 27740 raft_consensus.cc:1217] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20251214 21:04:43.663965 27740 raft_consensus.cc:1217] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20251214 21:04:43.875200 27740 raft_consensus.cc:1217] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20251214 21:04:43.886988 27681 raft_consensus.cc:1064] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c: attempting to promote NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a to VOTER
I20251214 21:04:43.887362 27681 consensus_queue.cc:237] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } }
I20251214 21:04:43.888413 27740 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 LEARNER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:43.888486 27573 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:43.888741 27819 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:43.888754 27910 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:43.889206 27910 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:43.889392 27886 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:43.890852 27886 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:43.891175 27573 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:43.892719 27740 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:43.892997 27819 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:43.893383 27319 catalog_manager.cc:5654] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 reported cstate change: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } attrs { replace: true } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:43.897862 27498 consensus_queue.cc:237] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } }
I20251214 21:04:43.898787 27819 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:43.898841 27740 raft_consensus.cc:1275] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:43.899118 27631 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:43.899296 27681 consensus_queue.cc:1048] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:43.900564 27681 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cacfd002884a45f8a129df8020e6ded6 (127.20.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:43.900971 27740 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cacfd002884a45f8a129df8020e6ded6 (127.20.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:43.901290 27819 raft_consensus.cc:2955] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cacfd002884a45f8a129df8020e6ded6 (127.20.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:43.902134 27304 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:04:43.902918 27316 catalog_manager.cc:5654] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c reported cstate change: config changed from index 3 to 4, VOTER cacfd002884a45f8a129df8020e6ded6 (127.20.32.3) evicted. New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:04:43.905064 27560 tablet_service.cc:1552] Processing DeleteTablet for tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 with delete_type TABLET_DATA_TOMBSTONED (TS cacfd002884a45f8a129df8020e6ded6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43268
I20251214 21:04:43.905639 27919 tablet_replica.cc:333] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: stopping tablet replica
I20251214 21:04:43.905858 27919 raft_consensus.cc:2243] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:43.906008 27919 raft_consensus.cc:2272] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:43.906612 27919 ts_tablet_manager.cc:1916] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:04:43.908591 27919 ts_tablet_manager.cc:1929] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20251214 21:04:43.908655 27919 log.cc:1199] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P cacfd002884a45f8a129df8020e6ded6: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-2-root/wals/b6b77cc1d2e4434a8b5a23ed5d786aa7
I20251214 21:04:43.909101 27305 catalog_manager.cc:4985] TS cacfd002884a45f8a129df8020e6ded6 (127.20.32.3:33175): tablet b6b77cc1d2e4434a8b5a23ed5d786aa7 (table test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]) successfully deleted
I20251214 21:04:44.177301 27920 raft_consensus.cc:1064] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: attempting to promote NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a to VOTER
I20251214 21:04:44.177693 27920 consensus_queue.cc:237] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } }
I20251214 21:04:44.179092 27740 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 LEARNER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251214 21:04:44.179142 27498 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251214 21:04:44.179275 27819 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251214 21:04:44.179500 27923 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251214 21:04:44.179713 27922 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251214 21:04:44.179870 27908 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251214 21:04:44.181681 27908 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.182076 27740 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.183709 27498 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.184266 27317 catalog_manager.cc:5654] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a reported cstate change: config changed from index 4 to 5, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cacfd002884a45f8a129df8020e6ded6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.185593 27819 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.188263 27573 consensus_queue.cc:237] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } }
I20251214 21:04:44.189332 27740 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20251214 21:04:44.189519 27819 raft_consensus.cc:1275] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Refusing update from remote peer cacfd002884a45f8a129df8020e6ded6: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20251214 21:04:44.189675 27923 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251214 21:04:44.189844 27908 consensus_queue.cc:1048] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251214 21:04:44.191275 27908 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER e6dae6a96e704090a803841fada0a24c (127.20.32.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.191715 27819 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER e6dae6a96e704090a803841fada0a24c (127.20.32.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.192523 27305 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet bac0097611aa492ab9588fa41e5c25ee with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:04:44.192817 27740 raft_consensus.cc:2955] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER e6dae6a96e704090a803841fada0a24c (127.20.32.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.193414 27316 catalog_manager.cc:5654] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 reported cstate change: config changed from index 5 to 6, VOTER e6dae6a96e704090a803841fada0a24c (127.20.32.2) evicted. New cstate: current_term: 1 leader_uuid: "cacfd002884a45f8a129df8020e6ded6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:04:44.196029 27487 tablet_service.cc:1552] Processing DeleteTablet for tablet bac0097611aa492ab9588fa41e5c25ee with delete_type TABLET_DATA_TOMBSTONED (TS e6dae6a96e704090a803841fada0a24c not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58344
I20251214 21:04:44.196491 27927 tablet_replica.cc:333] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: stopping tablet replica
I20251214 21:04:44.196674 27927 raft_consensus.cc:2243] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:44.197039 27927 raft_consensus.cc:2272] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:44.197675 27927 ts_tablet_manager.cc:1916] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:04:44.199635 27927 ts_tablet_manager.cc:1929] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20251214 21:04:44.199702 27927 log.cc:1199] T bac0097611aa492ab9588fa41e5c25ee P e6dae6a96e704090a803841fada0a24c: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-1-root/wals/bac0097611aa492ab9588fa41e5c25ee
I20251214 21:04:44.200169 27304 catalog_manager.cc:4985] TS e6dae6a96e704090a803841fada0a24c (127.20.32.2:37787): tablet bac0097611aa492ab9588fa41e5c25ee (table test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]) successfully deleted
I20251214 21:04:44.289539 27681 raft_consensus.cc:1064] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c: attempting to promote NON_VOTER 14b3c9e3d50f463ba465b2427ce2f84a to VOTER
I20251214 21:04:44.289992 27681 consensus_queue.cc:237] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } }
I20251214 21:04:44.291242 27573 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:44.291316 27740 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 LEARNER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:44.291683 27886 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:44.291841 27819 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20251214 21:04:44.291994 27910 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:44.292284 27886 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20251214 21:04:44.293890 27631 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.294245 27819 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.294299 27740 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.296281 27317 catalog_manager.cc:5654] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a reported cstate change: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.296430 27573 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 14b3c9e3d50f463ba465b2427ce2f84a (127.20.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9151de528de149029e1ddc479a91632a" member_type: VOTER last_known_addr { host: "127.20.32.1" port: 37275 } attrs { replace: true } } peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.299566 27497 consensus_queue.cc:237] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } }
I20251214 21:04:44.300504 27740 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:44.300743 27573 raft_consensus.cc:1275] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Refusing update from remote peer e6dae6a96e704090a803841fada0a24c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20251214 21:04:44.300992 27681 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:44.301162 27910 consensus_queue.cc:1048] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:44.302471 27910 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 9151de528de149029e1ddc479a91632a (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.302701 27573 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 9151de528de149029e1ddc479a91632a (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.303944 27740 raft_consensus.cc:2955] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 9151de528de149029e1ddc479a91632a (127.20.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } } }
I20251214 21:04:44.304463 27318 catalog_manager.cc:5654] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c reported cstate change: config changed from index 3 to 4, VOTER 9151de528de149029e1ddc479a91632a (127.20.32.1) evicted. New cstate: current_term: 2 leader_uuid: "e6dae6a96e704090a803841fada0a24c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e6dae6a96e704090a803841fada0a24c" member_type: VOTER last_known_addr { host: "127.20.32.2" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacfd002884a45f8a129df8020e6ded6" member_type: VOTER last_known_addr { host: "127.20.32.3" port: 33175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14b3c9e3d50f463ba465b2427ce2f84a" member_type: VOTER last_known_addr { host: "127.20.32.4" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20251214 21:04:44.305429 27304 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 25ada40c9f8d4da99eda6d54daad418c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:04:44.306481 27808 tablet_service.cc:1552] Processing DeleteTablet for tablet 25ada40c9f8d4da99eda6d54daad418c with delete_type TABLET_DATA_TOMBSTONED (TS 9151de528de149029e1ddc479a91632a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53680
I20251214 21:04:44.306819 27932 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:44.306974 27932 raft_consensus.cc:2243] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:44.307118 27932 raft_consensus.cc:2272] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:44.307626 27932 ts_tablet_manager.cc:1916] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:04:44.309309 27932 ts_tablet_manager.cc:1929] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20251214 21:04:44.309386 27932 log.cc:1199] T 25ada40c9f8d4da99eda6d54daad418c P 9151de528de149029e1ddc479a91632a: Deleting WAL directory at /tmp/dist-test-taskexS_UV/test-tmp/auto_rebalancer-test.0.AutoRebalancerTest.TestDeletedTables.1765746102914115-20608-0/minicluster-data/ts-0-root/wals/25ada40c9f8d4da99eda6d54daad418c
I20251214 21:04:44.309832 27304 catalog_manager.cc:4985] TS 9151de528de149029e1ddc479a91632a (127.20.32.1:37275): tablet 25ada40c9f8d4da99eda6d54daad418c (table test-workload [id=1a79a898a9ec40e9832b903d836a9c7f]) successfully deleted
W20251214 21:04:45.307556 27367 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver 14b3c9e3d50f463ba465b2427ce2f84a not available for placement
W20251214 21:04:46.308204 27367 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver 14b3c9e3d50f463ba465b2427ce2f84a not available for placement
I20251214 21:04:46.890659 20608 tablet_server.cc:178] TabletServer@127.20.32.1:37275 shutting down...
I20251214 21:04:46.893889 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:46.894084 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:46.894207 20608 raft_consensus.cc:2243] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:46.894340 20608 raft_consensus.cc:2272] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.894757 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:46.894831 20608 raft_consensus.cc:2243] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:46.894898 20608 raft_consensus.cc:2272] T 46988503d5024be48fb69a2b1d4536b1 P 9151de528de149029e1ddc479a91632a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.895187 20608 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:46.895252 20608 raft_consensus.cc:2243] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:46.895349 20608 raft_consensus.cc:2272] T bac0097611aa492ab9588fa41e5c25ee P 9151de528de149029e1ddc479a91632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.909018 20608 tablet_server.cc:195] TabletServer@127.20.32.1:37275 shutdown complete.
I20251214 21:04:46.911877 20608 tablet_server.cc:178] TabletServer@127.20.32.2:0 shutting down...
I20251214 21:04:46.916383 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:46.916592 20608 tablet_replica.cc:333] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c: stopping tablet replica
I20251214 21:04:46.916723 20608 raft_consensus.cc:2243] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:04:46.916946 20608 raft_consensus.cc:2272] T 46988503d5024be48fb69a2b1d4536b1 P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.917408 20608 tablet_replica.cc:333] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c: stopping tablet replica
I20251214 21:04:46.917487 20608 raft_consensus.cc:2243] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:04:46.917642 20608 raft_consensus.cc:2272] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.918005 20608 tablet_replica.cc:333] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c: stopping tablet replica
I20251214 21:04:46.918081 20608 raft_consensus.cc:2243] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:04:46.918231 20608 raft_consensus.cc:2272] T 25ada40c9f8d4da99eda6d54daad418c P e6dae6a96e704090a803841fada0a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.931352 20608 tablet_server.cc:195] TabletServer@127.20.32.2:0 shutdown complete.
I20251214 21:04:46.933758 20608 tablet_server.cc:178] TabletServer@127.20.32.3:0 shutting down...
I20251214 21:04:46.937667 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:46.937927 20608 tablet_replica.cc:333] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6: stopping tablet replica
I20251214 21:04:46.938055 20608 raft_consensus.cc:2243] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:46.938244 20608 raft_consensus.cc:2272] T bac0097611aa492ab9588fa41e5c25ee P cacfd002884a45f8a129df8020e6ded6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.938650 20608 tablet_replica.cc:333] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6: stopping tablet replica
I20251214 21:04:46.938735 20608 raft_consensus.cc:2243] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:46.938841 20608 raft_consensus.cc:2272] T 25ada40c9f8d4da99eda6d54daad418c P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.939148 20608 tablet_replica.cc:333] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6: stopping tablet replica
I20251214 21:04:46.939221 20608 raft_consensus.cc:2243] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:46.939306 20608 raft_consensus.cc:2272] T 46988503d5024be48fb69a2b1d4536b1 P cacfd002884a45f8a129df8020e6ded6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.952145 20608 tablet_server.cc:195] TabletServer@127.20.32.3:0 shutdown complete.
I20251214 21:04:46.954764 20608 tablet_server.cc:178] TabletServer@127.20.32.4:0 shutting down...
I20251214 21:04:46.958335 20608 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251214 21:04:46.958509 20608 tablet_replica.cc:333] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a: stopping tablet replica
I20251214 21:04:46.958614 20608 raft_consensus.cc:2243] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:46.958726 20608 raft_consensus.cc:2272] T b6b77cc1d2e4434a8b5a23ed5d786aa7 P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.959105 20608 tablet_replica.cc:333] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a: stopping tablet replica
I20251214 21:04:46.959175 20608 raft_consensus.cc:2243] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:46.959261 20608 raft_consensus.cc:2272] T 25ada40c9f8d4da99eda6d54daad418c P 14b3c9e3d50f463ba465b2427ce2f84a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.959529 20608 tablet_replica.cc:333] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a: stopping tablet replica
I20251214 21:04:46.959591 20608 raft_consensus.cc:2243] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251214 21:04:46.959664 20608 raft_consensus.cc:2272] T bac0097611aa492ab9588fa41e5c25ee P 14b3c9e3d50f463ba465b2427ce2f84a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.971771 20608 tablet_server.cc:195] TabletServer@127.20.32.4:0 shutdown complete.
I20251214 21:04:46.973742 20608 master.cc:561] Master@127.20.32.62:43059 shutting down...
I20251214 21:04:46.977000 20608 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:04:46.977250 20608 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:46.977301 20608 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7ea09f60014a4e819099454a84890338: stopping tablet replica
I20251214 21:04:46.989665 20608 master.cc:583] Master@127.20.32.62:43059 shutdown complete.
[ OK ] AutoRebalancerTest.TestDeletedTables (8347 ms)
[----------] 14 tests from AutoRebalancerTest (184073 ms total)
[----------] Global test environment tear-down
[==========] 14 tests from 1 test suite ran. (184073 ms total)
[ PASSED ] 13 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] AutoRebalancerTest.TestMaxMovesPerServer
1 FAILED TEST
I20251214 21:04:46.997767 20608 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 7 messages since previous log ~5 seconds ago
I20251214 21:04:46.997819 20608 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 7 messages since previous log ~5 seconds ago
I20251214 21:04:46.997845 20608 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/catalog_manager.cc:4712: suppressed but not reported on 6 messages since previous log ~5 seconds ago
I20251214 21:04:46.997874 20608 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/catalog_manager.cc:5332: suppressed but not reported on 3 messages since previous log ~29 seconds ago
I20251214 21:04:46.997908 20608 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 8 messages since previous log ~170 seconds ago
I20251214 21:04:46.997951 20608 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tablet/tablet.cc:2378: suppressed but not reported on 51 messages since previous log ~18 seconds ago
I20251214 21:04:46.998027 20608 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 16 messages since previous log ~8 seconds ago